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SOME  RECENT  RESULTS  OBTAINED  FROM  THE 
OTIS  GROUP  INTELLIGENCE  SCALE 

Stephen  S.  Colvin 
Brown  University 

During  the  school  year  of  1919-1920,  the  Otis  Group  Intelli- 
gence Scale,  Forms  A  and  B,  was  given  by  students  and  teachers 
under  the  writer's  direction  to  2,588  children  and  older  pupils  in 
various  schools  in  Massachusetts  and  Rhode  Island  as  is  shown  in 
the  following  table.  In  all  cases.  Form  A  of  the  tests  was  admin- 
istered first,  and  after  an  interval  of  some  days  or  weeks  Form  B 
was  given  under  approximately  identical  conditions. 

Schools  Grades     Pupils  Examiners 

Brookline,  Mass.  IV-IX       1,877       Teachers 

Miss     Wheeler's     Private      IV-XII         147       Teachers  and  G.  R.  Dolloff,  grad- 
School  for  Girls,  Provi-  uate  student,  Brown  University 

dence,  R.  I. 
Belmont     (Mass.)     Junior    VII-VIII        259      W.  A.  Nickerson,  teacher  at  Bel- 
High  School  mont,  graduate  student,  Boston 

University 
Reading   (Mass.)   High  IX  115       Mrs.  B.  H.  Cahill,  graduate  stu- 

School  dent,  Boston  University 

Bridgewater  Normal  School       N.  S.  190      Brenelle  Hunt,  Bridgewater  Nor- 

mal   School,    graduate    student, 
Boston  University 

The  results  of  the  tests  are  consistent  throughout  in  showing 
that  the  Otis  norms,  even  in  their  revised  form,  are  much  too  low 
for  the  group  of  children  tested.^  They  are  also  consistent  in 
showing  that  a  considerable  practice-effect  results  from  giving  the 
tests,  since  in  all  instances  the  averages  and  medians  for  Forii.  B 
are  definitely  higher  than  for  Form  A.  The  results  further  indi- 
cate that  in  a  large  majority  of  cases  the  tests  are  of  considerable 
prognostic  value  in  determining  the  scholastic  attainments  of  the 
pupils  examined.     These  results  will  be  discussed  in  more  detail. 

^  The  Haggerty  tests,  given  under  the  writer's  direction  to  a  small  group  of  chil- 
dren in  Providence  schools,  show  in  this  respect  similar  results. 
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Although  Otis  has  based  his  norms  on  the  results  of  the  ex- 
aminations of  many  thousand  school  children,  his  standards  are 
clearly  of  little  value  in  determining  the  actual  intelligence  of 
those  tested  in  the  schools  here  reported.  The  results  in  the 
Brookhne  schools  are  typical  and  enhghtening  in  this  respect. 
Both  the  median  scores  by  ages  and  the  median  scores  by  grades 
show  figures  decidedly  higher  than  the  Otis  standards  (see 
Table  I).  That  this  result  is  not  a  matter  of  chance  is  definitely' 
indicated  by  median  scores  and  I.  Q.'s  obtained  in  other  schools. 

TABLE  I.      BROOKLINE  (mASS.)  PUBLIC  SCHOOLS.      DISTRIBUTION 

OF  SCORES  OF  1,877  PUPILS  IN  OTIS  INTELLIGENCE  SCALE 

A.   BY  AGES 


Number 

Median 

Highest 

Lowest 

Age 

of  Cases 

Score 

Score 

Score 

m 

2 

81 

97 

65 

8 

16 

58 

105 

32 

8H 

60 

70.5 

124 

27 

9 

86 

67.5 

115 

14 

9H 

113 

78.5 

163 

26 

10 

142 

80.5 

164 

23 

lOJ^ 

146 

90 

172 

16 

11 

138 

94 

161 

21 

11^ 

157 

109 

194 

19 

12 

167 

118 

195 

24 

12^ 

153 

119.5 

192 

21 

13 

164 

130 

193 

32 

13K 

181 

133 

194 

36 

14 

116 

135.5 

191 

29 

14H 

98 

134.5 

203 

49 

IS 

97 

136 

193 

19 

16 

35 

124 

173 

69 

17 

6 

110 

152 

72 

B.   BY  GRADES  (iV  TO  DC  INCLUSIVE) 


Grade 

Number 

Median 

Highest 

Lowest 

of  Cases 

Score 

Score 

Score 

IV 

330 

63.5 

124 

14 

V 

332 

83 

164 

19 

VI 

360 

103.5 

172 

21 

VII 

261 

107 

195 

26 

VIII 

344 

133 

194 

49 

rx 

250 

148.5 

203 

77 
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TABLE  III.      MISS  WHEELER's  SCHOOL,  PROVIDENCE,  RHODE  ISLAND. 
OTIS  INTELLIGENCE  SCALE 

A.   CLASSIFICATION  OF  PUPILS.     GRADES  IV  TO  VII  INCLUSIVE 


Form 

Near 
Genius 

Very 
Superior 

Superior 

Normal 

Dull 

Border- 
line 

Total 

Number 
Tested 

A 

8 

14 

4 

14 

5 

3 

48 

B 

18 

11 

5 

7 

2 

2 

45 

B.   SCORES  BY  AGES.     JUNIOR  AND  SENIOR  HIGH-SCHOOL  GRADES 


Forms  A 

Age 

andB 

Averaged 

13 

151 

14 

158 

15 

166 

16 

173 

C.     SCORES  IN  FORMS  A  AND  B  FOR  FIVE  UPPER  GRADES 


Forms  A  and 

Correla- 

Form A 

FormB 

B   Combined 

Correla- 

tion (A 

Num- 

tion Be- 

and B 

Grade 

ber 

tween  A 

Com- 

Tested 

AND  B 

bined) 

Aver- 

Me- 

Aver- 

Me- 

Aver- 

Me- 

WITH 

age 

dian 

age 

dian 

age 

dian 

School 
Grades 

VIII 

24 

133 

141 

149 

153 

140 

148 

0.901 

0.801 

IX 

17 

144 

151 

165 

170 

154 

155 

0.720 

0.671 

X 

16 

155 

157 

173 

179 

164 

169 

0.699 

0.253 

XI 

24 

154 

161 

173 

172 

163 

164 

0.896 

0.345 

XII 

18 

169 

174 

186 

190 

177 

181 

0.854 

0.657 

All  Grades 

99 

150 

154 

168 

173 

159 

164 

0.827 

0.487 
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For  example,  results  obtained  from  Miss  Wheeler's  School  (see 
Table  III)  show,  from  the  fourth  to  seventh  grades  inclusive,  that 
considerably  more  than  half  of  the  pupils  tested  fall  in  the  classes 
near  genius,  very  superior,  or  superior,  while  only  a  small  percent 
are  below  the  average.  In  the  grades  of  both  the  junior  and  sen- 
ior high  school  the  medians  of  the  two  forms,  when  averaged  and 
compared  with  age  norms,  are  decidedly  above  the  Otis  medians 
for  adult  intelligence.  Similar  results  are  secured  when  the  me- 
dians of  the  combined  scores  of  the  five  upper  grades  are  calcu- 
lated, the  range  being  from  148  to  181  inclusive — from  18  to  51 
points  above  the  Otis  standards  for  adult  intelligence. 

Mr.  Nickerson's  results  in  the  Belmont  Junior  High  School,  as 
shown  in  Tables  IV  and  V,  point  in  the  same  direction.  For  ex- 
ample, of  124  pupils  in  the  eighth  grade  taking  Form  B,  97  at- 
tained ranks  normal  or  above  for  their  respective  ages,  and  only 
27  fell  below  this  rank.  Results  were  practically  the  same  for  the 
seventh  grade.  While  the  results  were  not  on  the  whole  as  pro- 
nounced as  in  the  case  of  the  other  schools,  the  evidence  is  clear 
that  here  the  Otis  standards  are  also  too  low. 

TABLE  V.      BELMONT   (mASS.)   JUNIOR  HIGH  SCHOOL. 
PEARSON  COEFFICIENTS  OF  CORRELATION 


Forms  A  and  B 

0.90 

Average  scores  and  marks 

(English,  arithmetic,  geography) . 

0.55 

Intelligence  ratings  and  marks 

(English,  arithmetic,  geography) . 

0.61 

Age-grade  (youngest  to  oldest)  and 

intelligence  scores 

0.34 

According  to  the  results  in  the  Reading  High  School  (Table 
VI),  nearly  76  percent  of  the  pupils  tested  show  average  mental 
ages  at  or  above  the  grade  in  which  they  are  working.  Only  24 
percent  of  the  pupils  tested  have  intelligence  ratings  below  aver- 
age;  while  48  percent  are  above  average — these  latter  falling  into 
the  superior,  very  superior,  or  near-genius  groups. 

The  results  obtained  from  the  Bridgewater  Normal  School  by 
Mr.  Hunt  (Figures  1  and  2)  relate  to  students  of  adult  age.  Here 
the  medians  for  all  classes  are  decidedly  above  the  Otis  norms  and 
the  classification  according  to  "coefficients  of  brightness"  shows 
that  there  is  not  a  single  student  below  average,  while  89  percent 
are  above. 
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TABLE  VI.      READING  (mASS.)  HIGH  SCHOOL. 
RESULTS  OF  OTIS  SCALE  WITH  115  FIRST- YEAR  PUPILS 


A.     DISTRIBUTION  OF  PUPILS  BY  TYPES 

ON  THE  BASIS  OF  THE  OTIS  REVISED 

NORMS 


B.     DISTRIBUTION    OF   PUPILS   ACCORDINO 
TO  MENTAL  AND  CHRONOLOGICAL  AGES 


Classification 

Percent 
of  Pupils 

Genius 

0.8 

Very  Superior  . . 

Superior 

Normal 

Dull 

32.2 
15.6 
27.1 
15.6 

Borderline 

8.7 

Percent 

Average 

Average  Chron- 

of Cases 

Mental  Age 

ological  Age 

3.0 

10.6 

14.8 

6.0 

11.4 

14.8 

9.0 

12.5 

14.9 

15.0 

13.4 

14.7 

15.0 

14.4 

14.6 

5.0 

15.6 

14.5 

3.0 

16.5 

14.7 

7.0 

17.2 

14.8 

37.0 

18.0 

14.2 

Three  possible  explanations  for  the  above  results  suggest 
themselves,  namely:  (1)  the  norms  have  not  been  carefully  de- 
rived by  Otis  from  representative  groups;  (2)  the  individuals  ex- 
amined in  the  tests  here  reported  form  a  superior  group;  (3)  the 
tests  necessarily  measure  school  accomplishment  of  a  certain  type 
(not  merely  general  intelligence)  and  the  individuals  tested  had 
superior  instruction  in  those  particular  elements  on  which  the 
tests  are  based.  Of  these  three  explanations  we  can  probably  ex- 
clude the  second.  It  is  hardly  plausible  that  the  pupils  tested  in 
the  present  study  are  markedly  superior  to  the  rank  and  file  of 
school  children,  and  that  a  large  percent  are  in  the  superior  and 
near-genius  groups. 

The  first  explanation  is  possible,  though  it  is  reasonable  to  as- 
sume that  the  norms  derived  by  Otis  are  from  fairly  representa- 
tive groups  and  constitute  reasonable  samplings  of  school  children 
in  general.  It  is  also  to  be  assumed  that  the  norms  as  obtained  by 
Otis  from  various  sources  have  been  carefully  derived,  and  that 
there  is  no  large  error  resulting  from  statistical  inaccuracies.  Even 
if  such  errors  exist,  they  are  not  likely  to  be  constant  and  would 
probably  tend  to  even  themselves  up  in  the  tabulation  of  the  large 
number  of  cases  on  which  the  norms  are  based. 

The  third  explanation  seems  the  most  reasonable  in  account- 
ing for  a  substantial  amount  of  the  disagreement  found  between 
the  Otis  norms  and  the  results  here  reported,  namely,  that  the 
Otis  tests  furnish  materials  which  give  a  greater  advantage  to  the 
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individuals  tested  in  the  present  study  than  to  those  from  whom 
Otis  has  obtained  his  norms.  The  Otis  tests  are  primarily  liter- 
ary tests;  they  are  based  on  a  knowledge  of  words  and  skill  in  the 
use  of  words.     They  put  a  premium  on  linguistic  ability,  and  make 
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it  possible  for  pupils  who  have  had  superior  training  in  this  respect, 
other  things  being  equal,  to  obtain  higher  scores. 

And  here  a  word  in  regard  to  intelligence  tests  in  general  may 
not  be  out  of  place.  No  intelligence  test  yet  devised,  and  in  all  prob- 
ability none  that  ever  can  be  devised,  is  capable  of  measuring  general 
intelligence  except  indirectly.  These  tests  measure  attainment 
which  is  conditioned  on  learning.  When  a  group  of  individuals 
vary  in  any  test  in  which  all  have  had  the  same  incentives  for  learn- 
ing and  the  same  opportunities  and  interests  in  learning,  the  as- 
sumption is  that  this  variation  is  due  to  differences  in  original 
ability.  For  this  reason  not  only  are  intelligence  tests  measures 
of  original  capacity,  but  so  also  are  the  various  attainment  tests 
in  school  subjects.  Hence  the  Trabue  Completion  Test,  devised 
as  a  measure  of  linguistic  ability,  is  also  a  measure  of  intelligence; 
hence  the  Courtis  arithmetic  tests  not  only  measure  attainment 
in  fundamental  operations,  but  they  likewise  discriminate  be- 
tween the  innate  abilities  of  the  children  tested.  There  has  never 
been  devised  and  there  will  probably  never  be  devised  a  general  test 
for  general  intelligence.  All  tests  are  valid  only  within  a  group 
who  have  had  identical  or  very  similar  opportunities  for  gaining 
familiarity  with  the  materials  of  the  test,  and  who  not  only  have 
had  the  opportunity  to  learn,  but  likewise  the  desire  to  learn. 
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The  fact  that  a  group  of  girls  score  decidedly  lower  in  the  Sten- 
quist  Mechanical  Ingenuity  Tests  than  a  similar  group  of  boys 
does  not  prove  by  any  means  that  girls  are  inferior  in  innate  me- 
chanical intelligence  to  boys.  Neither  does  the  fact  that  girls 
and  women,  almost  without  exception,  show  median  scores  in- 
ferior to  those  obtained  by  similar  groups  of  boys  and  men  in  the 
Alpha  Army  Tests  of  necessity  indicate  that  the  former  are  in- 
ferior to  the  latter  in  general  intelligence.  It  is  not  to  be  expected 
that  intelligence  tests  can  be  standardized  so  as  to  measure  the 
innate  intelligence  of  diversified  groups.  Such  tests  are  valid 
only  as  comparative  measures  within  groups.  It  is  very  difficult, 
if  not  impossible,  to  compare  the  intelligence  of  dissimilar  groups. 

The  practice  effect  shown  by  the  fact  that  the  median  scores 
in  the  second  test  of  the  Otis  pairs  are  considerably  higher  than 
those  in  the  first  set  is,  of  course,  to  be  expected.  In  the  writer's 
experience  this  is  almost  certain  to  be  true  when  any  two  tests, 
of  approximately  equal  difficulty,  are  given  to  any  group  of  fair 
size.  In  the  case  of  hundreds  of  tests  given  to  thousands  of  in- 
dividuals either  by  the  writer  or  under  his  direction,  he  has  found 
but  one  instance  when  a  reversal  of  this  result  occurred.  This 
was  in  a  group  of  about  35  seniors  in  the  Women's  College  in 
Brown  University  in  which  the  scores  in  a  pair  of  the  Trabue 
Completion  Tests  were  somewhat  higher  in  the  first  test  than  in 
the  second. 

In  the  case  of  the  present  study,  on  the  average,  the  second  test 
showed  about  a  10  percent  improvement  over  the  first.  In  one 
instance,  the  seventh  grade  of  the  Belmont  Junior  High  School, 
a  20  percent  improvement  is  shown  (see  Table  IV).  The 
results  from  Miss  Wheeler's  School  are  typical  (see  Table  III). 
In  the  writer's  experience  the  improvement  to  be  expected  in  the 
second  test  over  the  first  is  from  6  to  10  percent.  In  this  con- 
nection it  is  to  be  noted  that  in  the  Thorndike  Intelligence  Ex- 
amination for  High  School  Graduates  the  improvement  in  the 
second  of  two  identical  tests  over  the  first,  when  preceded  by  a 
fore-exercise  giving  some  familiarity  with  the  nature  of  these  two 
tests,  is  much  reduced.  Results  obtained  at  Brown  University 
with  285  freshmen  of  the  Class  of  1923,  to  whom  the  Thorndike 
tests  were  given,  showed  an  improvement  of  less  than  2  percent. 
Evidently  some  such  device  as  a  fore-exercise  for  preliminary 
orientation,  or  a  spiral  scheme  in  which  the  same  type  of  test  oc- 
curs again  and  again  in  the  course  of  an  examination,  as  is  the  case 
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with  the  Thurstone  Psychological  Examination  is  of  considerable 
importance  in  the  technic  of  administration. 

Although  the  Otis  tests  seem  to  be  of  little  value  in  discovering 
the  exact  intelligence  ratings  of  those  examined,^  they  are  clearly 
useful  in  indicating  the  relative  intelligence  of  the  children  tested 
within  a  given  group.  This  fact  is  brought  out  by  the  agreement 
between  the  results  of  the  tests  and  the  school  standing  of  the 
pupils  examined.  The  correlations  are,  on  the  whole,  pronounced, 
in  some  cases  being  unusually  high.  Forty-four  correlations  cal- 
culated between  the  test  scores  in  the  Brookline  schools  and  the 
scholarship  records  give  the  lowest  Pearson  coefficient  0.40  and 
the  highest  0.91 .  The  median  is  0.69.  Seven  of  these  coefficients 
are  between  0.40  and  0.49,  eight  between  0.50  and  0.59,  eight 
between  0.60  and  0.69,  thirteen  between  0.70  and  0.79,  seven  be- 
tween 0.80  and  0.89,  and  one  between  0.90  and  1.00  (see  Table  II). 

In  Miss  Wheeler's  School,  correlations  between  scores  in  the 
tests  and  school  standing  were  computed  for  the  five  upper  grades. 
These  varied  from  0.253  to  0.801  when  calculated  grade  for  grade. 
The  correlation  of  the  scores  of  all  the  pupils  tested  in  these  five 
grades  with  their  school  marks  was  0.487  (see  Table  III). 

In  the  Belmont  Junior  High  School,  the  average  scores  in  the 
tests  when  compared  with  the  average  of  school  marks  in  English, 
arithmetic,  and  geography  gave  a  Pearson  coefficient  of  0.55. 
When  the  scores  were  reduced  to  intelligence  ratings  the  correla- 
tion was  0.61  (see  Table  V).  Of  124  eighth-grade  pupils  taking 
the  test,  97  obtained  ranks  normal  or  above  for  their  re- 
spective ages.  Of  the  27  failing  to  attain  such  a  rank,  17  failed 
to  receive  a  passing  mark  in  their  school  subjects.  Five  of  the 
27  were  repeating  the  grade;  seven  were  promoted  on  conditions; 
one  was  demoted;  four  were  manual  training  specials.  The  rat- 
ing of  these  pupils  by  their  teachers  was  as  follows:  seven,  fair; 
fifteen,  poor;  three,  very  poor.  Of  the  97  pupils  who  passed  the 
test  with  scores  at  least  normal,  only  13  were  estimated  as  below 
fair  or  passable  in  regular  school  work,  84  receiving  marks  of  three 
or  better  (on  a  basis  of  five).  The  correlation  between  the  C.  B's. 
of  these  124  pupils  and  their  average  rank  in  four  school  subjects 

^  The  results  set  forth  above  are  in  substantial  agreement  with  results  reported 
to  the  writer  by  other  investigators  who  have  administered  the  tests  in  various  school 
systems. 


12  JOURNAL  EDUCA TIONAL  RESEA RCH         Vol.  3,  No.  1 

was  0.586.  Results  from  a  study  of  conditions  in  the  seventh 
grade  were  very  similar. 

The  data  from  the  tests  given  to  the  freshmen  of  the  Reading 
High  School  showed  on  the  whole  less  definite  results  and  gave 
low  correlations  with  school  standing,  the  Pearson  coefficient 
between  the  I.  Q.'s  and  the  average  of  the  academic  grades  being 
0.344.  In  a  total  of  65  failures  received  in  all  subjects  of  the 
freshman  year,  40  percent  were  made  by  those  pupils  who  fell 
below  the  normal  or  average  group  according  to  the  Otis  classifi- 
cation, and  60  percent  were  made  by  those  who  were  in  the 
normal  group  or  above  it. 

No  correlation  coefficients  were  obtained  from  the  results  ob- 
tained by  Mr.  Hunt  at  the  Bridgewater  Normal  School.  Figure 
2,  however,  indicates  that  there  is  a  close  agreement  both  between 
teachers'  marks  and  scores  divided  into  quintiles,  and  teachers' 
marks  and  the  calculated  C.  B.'s.  Figure  1  shows  also  that  the 
senior  students  are  slightly  superior  to  the  junior  students,  while 
the  three-year  students  (those  taking  a  longer  course  than  the 
one  usually  elected)  are  more  definitely  superior.  Evidently  the 
better  course  is  elected  by  the  more  capable  individuals. 

One  more  fact  of  some  significance  may  be  noted,  namely,  that 
in  most  instances  there  is  a  substantial  agreement  between  the 
results  obtained  from  the  two  series  of  tests.  The  scores  in  Forms 
A  and  B  were  correlated  in  49  instances  with  the  following  re- 
sults: in  fourteen  instances  the  coefficient  was  between  0.90  and 
1.00;  in  twenty-five  instances,  between  0.80  and  0.90;  in  seven 
instances,  between  0.70  and  0.80;  in  one  instance,  between  0.60 
and  0.70;  in  one  instance,  between  0,50  and  0.60;  and  in  one  in- 
stance, between  0.30  and  0.40. 

The  final  conclusion  to  be  drawn  from  an  examination  of  the 
results  of  these  tests  is  that  they  serve  a  very  useful  purpose  in 
determining  the  comparative  intelligence  of  school  children  and 
that  their  prognostic  value  is  reasonably  high.  On  the  other 
hand,  they  are  quite  misleading  as  measures  of  absolute  intelli- 
gence, and  attempts  to  determine  intelligence  quotients  or  coeffi- 
cients of  brightness  based  on  results  obtained  and  interpreted  in 
terms  of  the  standards  so  far  published  by  Otis  are  of  little  value. 
The  Otis  norms  must  be  fundamentally  revised  before  they  can 
be  accepted  without  correction. 


CONDITIONS  REVEALED  BY  THE  USE  OF  STANDARD- 
IZED TESTS  IN  RURAL  SCHOOLS^ 

Samuel  S.  Brooks 
District  Superintendent,  Silver  Lake,  New  Hampshire 

While  making  out  the  graph  cards  of  individual  pupils  for 
grading  purposes  as  described  in  my  last  article,  I  gradually 
became  conscious  of  certain  similar  tendencies  affecting  the 
majority  of  graphs.  Not  only  was  the  variation  great  among 
individuals  in  different  subjects  but  there  was  a  certain  sameness 
in  it  that  struck  me  as  being  significant  of  fundamental  weaknesses 
in  the  school  system.  If  the  graphs  had  been  on  transparent 
cards  and  placed  in  a  pile,  their  low  and  high  points  would  have 
tended  to  coincide.  That  is,  in  certain  subjects  most  of  the 
pupils  tended  to  grade  high  throughout  the  district  while  in 
other  subjects  they  tended  to  grade  low. 

In  the  accompanying  figures  the  numbers  at  the  left  of  the 
horizontal  lines  represent  the  grades,  while  those  at  the  top  of  the 
vertical  lines  stand  for  the  various  subjects  as  follows: 

1.  Rate  of  silent  reading  9.  Writing,  rate 

2.  Comprehension  in  reading  10.  Writing,  quality 

3.  Addition  11.  Arithmetical  reasoning 

4.  Subtraction  12.  English  organization 

5.  Multiplication  13.  Visual  vocabulary 

6.  Division  14.  Language 

7.  Mixed  fundamentals  of  arith-      15.  Geography 

metic  16.  History 

8.  Spelling 

In  each  of  these  figures  the  heavy  horizontal  line  is  drawn 
at  the  grade  in  which  the  pupil  was  placed  as  a  result  of  the 
September  testing.  (See  the  third  article  of  this  series.)  The 
solid  lines  show  the  grading  of  the  pupils  according  to  each  of  the 
tests  at  the  beginning  of  the  year;  the  broken  lines  show  their 
grading  at  the  end  of  the  year.  In  interpreting  these  figures  it 
should  be  remembered  that  the  grading  is  based  on  June  scores. 
In  other  words,  if  a  child's  score  on  any  test  equals  the  standard 

'  This  is  the  fourth  article  by  Superintendent  Brooks  on  the  general  topic  "Putting 
Standardized  Tests  to  Practical  Use  in  Rural  Schools." 
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for  the  fourth  grade,  his  performance  is  that  of  a  child  who  has 
completed  the  fourth  grade.  Since  his  scores  (obtained  in 
September)  indicate  that  he  has  already  attained  fourth-grade 
proficiency,  he  will  naturally  be  placed  in  the  class  which  is  just 
beginning  the  fifth-grade  work. 
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In  Figure  1  the  solid  line  shows  the  curve  of  Scott,  a  twelve- 
year-old,  fifth-grade  boy  in  one  of  the  Sandwich  schools,  at  the 
beginning  of  the  year.  The  high  and  low  points  are  more  pro- 
nounced than  in  most  cases.  The  solid  lines  in  Figures  2  and  3 
are  the  September  curves  of  two  other  pupils  drawn  at  random 
from  among  the  cards  of  the  Madison  and  Tamworth  schools. 
All  three  of  these  pupils  are  normal  or  above  according  to  the 
Otis  Group  Intelligence  Scale.  The  broken  lines  in  these  figures 
are  the  end-of-the-year  curves. 

It  will  help  in  the  understanding  of  the  figures  to  take  the  case 
of  a  particular  child.  Consider  the  record  of  Paul  (Figure  3). 
His  score  in  the  September  test  for  rate  of  silent  reading  was  62. 
The  third-grade  score  for  rate  of  silent  reading  is  60.  Accordingly, 
this  boy  showed  third-grade  ability  in  rate  of  silent  reading  in 
the  first  test.  The  first  point  on  the  solid  line  is  therefore  located 
at  the  intersection  of  the  third-grade  line  with  the  vertical  line 
No.  1.    In  the  June  test  Paul's  score  for  rate  of  silent  reading 
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was  97.  Since  97  is  midway  between  92  and  102,  the  standard 
scores  for  the  sixth  and  seventh  grades  respectively,  the  first 
point  on  the  broken  line  is  located  about  half  way  between  the 
sixth-  and  seventh-grade  lines  on  the  vertical  line  No.  1. 
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Similarly,  in  the  first  test  his  score  for  comprehension  was  12, 
which  is  somewhat  below  the  fourth-grade  standard.  His  score 
on  the  second  tests,  however,  was  quite  equal  to  the  standard 
of  the  seventh  grade. 
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The  reader's  attention  is  directed  to  the  fact  that  in  all  the 
accompanying  figures  there  is  a  tendency  for  the  valleys  and 
peaks  of  the  curve  for  the  June  test  to  flatten  out  toward  the 
horizontal.  This  represents  the  effect  of  the  measures  taken  in 
these  figures  in  the  interim  between  September  and  June. 

It  will  be  noted  that  these  pupils  stood  high  in  the  four  funda- 
mental operations  of  arithmetic  (Numbers  3,  4,  5,  6,  and  7) 
and  in  Greene's  English  Organization  Test  (Number  12),  which 
is  mostly  a  test  of  general  intelligence.  In  arithmetical  reasoning 
or  problem-solving  (11),  spelling  (8),  and  language  (14),  they 
were  near  to  grade  standards.  In  rate  (1)  and  comprehension 
(2)  of  silent  reading,  in  rate  (9)  and  quality  (10)  of  handwriting, 
in  visual  vocabulary  (13),  and  in  the  content  subjects  (15  and  16) 
each  of  these  pupils  ranked  from  low  to  very  low. 

The  graphs  of  72.24  percent  of  all  the  normal  pupils  above 
the  third  grade  showed  the  same  tendencies  to  a  greater  or  less 
degree.2  Figure  4  is  a  sort  of  composite  graph  of  all  the  normal 
seventh-grade  pupils  in  the  district.  They  numbered  62.  Figure 
5  is  a  similar  graph  for  the  104  normal  fourth-grade  children. 
These  graphs  were  obtained  by  averaging  the  scores  of  the 
pupils  in  each  separate  subject  and  using  the  grades  correspond- 
ing to  the  averages  to  locate  the  points  on  the  graphs.  For 
example,  at  the  September  test  the  average  seventh-grade  score 
for  rate  of  silent  reading  was  95.2.  This  is  a  little  above  the 
standard  fifth-grade  score  of  93.  Hence  the  first  point  on  the 
solid  curve  in  Figure  4  is  located  just  above  the  fifth-grade  line. 
Similarly,  the  average  of  all  the  seventh-grade  scores  in  compre- 
hension of  reading  was  17.8.  Since  this  is  about  two-thirds  of 
the  way  from  the  fourth-grade  standard  toward  that  of  the  fifth 
grade,  the  second  point  is  located  two-thirds  of  the  way  between 
the  fourth-  and  fifth-grade  lines. 

Having  observed  in  the  graphs  these  general  tendencies  of 
which  I  have  spoken,  I  next  made  a  survey  of  the  time-tables 
and  teaching  methods  in  vogue  in  the  district  in  order  to  formu- 
late reasonable  hypotheses  to  account  for  the  conditions  thus 
revealed  and  in  order  to  aid  in  planning  remedial  measures. 

The  universally  high  scores  in  all  the  tested  phases  of  arith- 
metic were  indicative  of  over-emphasis  on  this  subject.     The 

^  In  making  this  study  the  cards  of  all  children  who  ranked  below  normal  according 
to  the  intelligence  tests  were  thrown  out. 
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time-tables  showed  the  relatively  large  amount  of  time  assigned 
to  arithmetic.  The  idea  seems  to  be  prevalent  among  teachers, 
pupils,  and  parents  that  arithmetic  is  the  all-important  subject. 
These  schools  are  no  doubt  typical  of  the  schools  in  small  rural 
communities.  Moreover,  being  widely  scattered,  they  have  little 
communication  with  each  other.  It  would  seem,  therefore,  that 
the  results  of  this  study  fairly  represent  conditions  in  most  of  the 
smaller  rural  schools  where  standardized  tests  have  not  been 
used  and  where  their  diagnostic  values  have  not  been  realized. 

I  am  aware  that  these  findings  are  contrary  to  those  of  more 
eminent  workers  who  have  found  arithmetic  to  be  a  subject  in 
which  pupils  usually  grade  low  when  measured  by  standardized 
tests.  Possible  reasons  for  this  difference  may  be  (1)  that  the 
results  from  all  the  pupils  were  considered  instead  of  only  the 
normal  ones  and  (2)  that  their  tests  were  given  in  city  schools. 

This  over-emphasis  on  arithmetic  in  the  smaller  rural  schools 
is  not  an  unnatural  condition.  In  fact  there  are  sound  reasons 
for  it.  In  the  first  place,  arithmetic  is  easier  for  the  untrained 
teacher  to  teach  than  the  content  subjects.  Fair  results  can 
probably  be  obtained  with  less  mental  effort  on  the  part  of  the 
teacher  in  the  teaching  of  arithmetic  than  in  the  teaching  of 
history  and  geography.  The  work  is  largely  a  matter  of  drill,  and 
drill  is  easy  for  the  teacher.  In  the  second  place,  teachers  usually 
have  more  immediately  obvious  success  in  the  teaching  of  arith- 
metic. It  is  human  nature  to  like  to  do  the  things  in  which  we 
best  succeed.  In  the  third  place,  pupils  like  arithmetic  (a) 
because  they  enjoy  good  lively  drill  work  in  the  fundamentals; 
(b)  because  they  do  not  feel  quite  so  much  "at  sea"  in  preparing 
an  assignment  of  the  next  ten  problems  in  arithmetic  as  they  do 
in  facing  an  assignment  of  the  next  ten  pages  in  history  or  geog- 
raphy or  physiology;  and  (c)  because  children  like  puzzles. 
The  older  pupils  especially  enjoy  solving  the  problems  of  this 
character  which  our  textbooks  abundantly  supply.  In  the  fourth 
place,  when  it  is  left  to  the  children  to  divide  their  study  time 
among  the  different  school  subjects — as  has  been  the  common 
custom  in  unsupervised  rural  schools — an  undue  amount  of  time 
will  usually  be  spent  on  arithmetic.  Not  knowing  what  to  do 
with  improperly  assigned  lessons  in  the  content  subjects,  but 
knowing  that  they  must  keep  busy  at  something,  children  will 
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turn  to  their  arithmetics  with  which  they  feel  most  capable  of 
doing  independent  work.  Finally,  the  demands  of  parents  on 
the  teacher  that  their  children  be  "learnt  how  to  figger"  is  another 
factor  in  the  situation.  All  these  reasons  cooperate  in  bringing 
about  over-emphasis  on  arithmetic  in  the  rural  schools. 

As  the  beginning  of  an  attempt  to  remedy  this  condition 
we  decided  to  reduce  for  a  while  the  time  devoted  to  arithmetic 
by  one-half  and  to  use  the  time  thus  gained  for  subjects  in  which 
the  schools  were  making  a  poor  showing. 

Arithmetic  was  the  only  school  subject  in  which  there  ap- 
peared a  general  tendency  to  rank  very  much  above  grade.  The 
only  other  markedly  high  spot  in  the  graphs  was  that  denoting 
their  grading  in  Greene's  English  Organization  Test.  In  this 
test  the  pupils  demonstrate  their  ability  or  lack  of  ability  to 
rearrange  broken  sentences  so  as  to  make  sense.  Here  is  a  sample 
of  the  disarranged  sentences  of  which  the  test  is  composed: 

wanted,  to  go  home,  him,  the  dog 

Since  this  is  largely  a  test  of  intelligence,  the  prevalent  high 
scores  of  the  pupils  simply  go  to  show  that  their  low  ratings  in 
subjects  other  than  arithmetic  were  not  due  to  lack  of  mental 
ability,  a  fact  also  supported  by  their  scores  in  the  Otis  Group 
Intelligence  Scale. 

The  average  scores  for  problem-solving  in  arithmetic  were 
close  to  grade  standards  for  each  grade.  The  reason  why  the 
pupils  did  not  do  as  well  in  this  particular  phase  of  arithmetical 
ability  as  they  did  in  fundamentals  will  be  discussed  a  little  later. 
Spelling  and  language  are  other  subjects  in  which  drill  work 
figures  very  prominently.  Although  on  each  of  these  two 
subjects  there  were  wide  differences  between  the  lowest  and  high- 
est scores  in  each  grade,  the  averages  were  well  up  to  or  above 
standard,  as  shown  by  the  solid  lines  in  Figures  4  and  5. 

Writing  averaged  the  lowest  of  all  the  subjects  in  every 
school  but  one.  The  teacher  of  this  school  had  received  business 
college  training  and  was  good  in  muscular-movement  penmanship. 
The  low  averages  in  writing  led  me  to  make  a  special  investigation 
of  the  methods  of  teaching  that  subject  in  the  district.  A  round 
of  observation  convinced  me  not  only  that  the  teaching  of  writing 
was  being  neglected  but  also  that  what  teaching  there  was  had 
little  value.     The  copy-book  method  was  in  use  in  every  school 
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except  the  one  mentioned  above.  The  teachers  in  general  did 
not  know  how  to  teach  writing.  Therefore  they  had  little 
success  with  it  and  did  not  like  to  teach  it.  Upon  inquiry  as  to 
how  the  writing  period  was  conducted,  I  learned  that  in  several 
cases  at  least  the  teacher  would  simply  tell  the  pupils  to  take  their 
writing  books  and  write  for  ten  minutes.  During  this  time  she 
would  sit  at  her  desk  and  correct  papers.  At  the  end  of  the 
period,  without  even  looking  at  the  copy  books  she  would  tell 
them  to  put  away  their  writing  materials  and  go  on  with  other 
work.  In  very  few  of  the  writing  periods  that  I  observed  person- 
ally was  there  any  adequate  attempt  to  teach  the  children  how  to 
write.  Is  it  strange  that  the  writing  scores  were  disgracefully 
low?  I  wonder  if  this  condition  is  typical  of  schools  in  smaller 
rural  communities  with  untrained  teachers  or  is  it  a  specialty  of 
this  district? 

In  an  attempt  to  remedy  the  condition  I  tried  to  arouse  the 
teachers  to  its  seriousness,  and  I  introduced  a  method  of  business 
writing  into  all  the  schools.  This  was  somewhat  of  a  venture 
since  most  of  the  teachers  had  had  no  training  in  muscular- 
movement  writing.  However,  they  were  all  informed  regarding 
the  correspondence  course  for  teachers  conducted  by  the  pub- 
lishers of  the  system,  and  were  encouraged  to  take  it.  Several  of 
them  did  so,  and  by  the  end  of  the  year  they  were  doing  passable 
work  as  teachers  of  the  new  method. 

As  a  result  of  this  radical  change  the  writing  conditions  in 
the  schools  are  now  in  a  somewhat  chaotic  condition.  It  takes 
time  to  break  up  the  old  finger-movement  habits  and  perfect 
new  ones.  Hence  the  graphs  show  little  improvement  in  writing 
scores  for  the  year.  We  hope,  however,  that  during  the  coming 
year  a  continuation  of  our  efforts  will  produce  definite  improve- 
ment in  the  quality  of  handwriting. 

The  chief  difficulty  seems  to  be  to  get  the  children  to  use  the 
muscular  movement  outside  of  the  period  of  writing  drill.  Here- 
after, in  order  to  further  our  efforts,  no  written  work  will  be 
accepted  unless  it  is  done  with  muscular  movement.  We  believe 
it  is  largely  a  waste  of  time  to  compel  a  pupil  to  write  with  muscu- 
lar movement  for  ten  mintues  a  day  and  then  to  let  him  use  finger 
movement  in  writing  his  compositions. 

The  reading  scores  were  also  scandalously  low.  Both  the 
individual  graphs  (Figures  1,  2,  and  3)  and  the  grade  graphs 
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(Figures  4  and  5)  exhibit  this  fact  in  a  striking  manner.  Analysis 
of  the  situation  furnished  several  quite  probable  reasons  for  the 
poor  showing  in  silent  reading. 

First,  the  pupils  had  not  been  taught  silent  reading.  The 
reading  drill  in  the  schools  was,  and  always  had  been,  oral.  Only 
two  or  three  of  the  teachers  had  any  conception  of  what  is  meant 
by  silent-reading  drill.  The  oral  reading  was  conducted  in  the 
old-fashioned  way  which  needs  no  description — and  mostly  in  a 
slipshod  manner  at  that.  The  fact  that  the  children  were  tested 
for  silent  reading  when  all  their  class  work  had  been  in  oral  reading 
was  probably  the  chief  reason  for  the  low  scores. 

Second,  in  most  of  the  schools  there  was  only  one  set  of 
readers  for  each  grade.  The  younger  pupils  knew  most  of  the 
stories  in  the  upper-grade  books  from  hearing  them  read  over 
and  over  by  the  older  pupils.  The  fact  that  they  knew  the  gist 
of  these  stories  long  before  they  ever  reached  the  grades  in  which 
the  books  were  used,  that  they  had  ''studied"  the  lesson  over 
several  times  at  their  seats  (perhaps),  and  that  each  pupil  was 
provided  with  a  book  in  class,  precluded  any  chance  for  real,  live 
interest  in  the  class  drill.  Many  of  the  teachers,  even,  did  not 
seem  to  be  over-enthusiastic. 

Third,  the  low  scores  resulting  from  the  use  of  Thorndike's 
Visual  Vocabulary  Tests  indicate  that  lack  of  word  knowledge 
probably  accounted  to  a  large  degree  for  the  poor  results  in 
reading.  It  may  well  be  that  the  narrow  range  of  reading,  due  to 
lack  of  variety  in  books  and  to  the  conspicuous  absence  of  school 
libraries,  was  responsible  for  the  limited  reading  vocabularies  of 
the  children. 

In  the  light  of  the  above  described  conditions  the  low  scores 
in  content  subjects  need  little  explanation.  Success  in  history, 
geography,  etc.,  depends  on  ability  to  study  effectively.  Efficient 
study  is  efficient  silent  reading.  Even  in  arithmetic,  much  if  not 
most  of  the  difficulty  encountered  by  the  pupils  in  solving  prob- 
lems lies  in  their  inability  to  read  and  understand  them  as  they 
appear  in  the  text.  Poor  ability  in  silent  reading,  then,  helps  to 
explain  why  the  scores  in  the  problem-solving  phase  of  arithmetic 
were  so  much  lower  than  those  in  the  fundamental  operations. 

These  matters  were  brought  to  the  attention  of  the  teachers. 
They  readily  concluded  that  reading  is  the  most  important  sub- 
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ject  in  the  school,  because  upon  it  depends  success  in  most  of  the 
other  subjects.  We  therefore  decided  to  give  reading  a  place  in 
the  program  commensurate  with  its  importance.  For  the  rest 
of  the  year  most  of  the  reading  time  was  devoted  to  intensive  drill 
in  silent  reading.  Different  methods  of  conducting  this  drill 
were  devised  in  order  to  furnish  variety  and  in  order  to  keep 
interest  alive.  Much  of  the  work  in  geography,  history,  physiol- 
ogy, civics,  etc.,  was  taken  up  as  class  drill  in  silent  reading.  Oral 
quizzes  every  few  days  by  way  of  review  in  these  subjects  took 
the  place  of  the  customary  daily  question-and-answer  recitation. 
In  this  way  the  time  usually  available  for  reading  drill  was 
quadrupled. 

Did  so  much  reading  drill  get  monotonous?  The  children 
will  testify  that  it  did  not.  Did  the  content  subjects  suffer  from 
giving  up  so  much  seat  study  and  question-and-answer  recitation? 
The  graphs  clearly  indicate  the  answer. 

We  adopted  also  a  definite  policy  of  vocabulary  building. 
New  words  were  constantly  introduced  to  the  pupils  by  psy- 
chological methods.  They  were  introduced  as  the  names  of 
ideas  after  the  ideas  themselves  had  been  vividly  brought  to  their 
attention  by  objects,  pictures,  or  lively  descriptions. 

The  number  of  reading  books  in  the  schools  was  multiplied 
by  ten  or  twelve,  and  a  generous  beginning  of  school  libraries  was 
made.  For  the  most  part  the  new  books  were  informational 
rather  than  merely  entertaining.  Yet  they  were  books  that 
appeal  to  children — and,  indeed,  they  did  appeal  to  them.  Our 
difficulty  now  is  not  in  getting  the  pupils  to  read  but  in  getting 
them  to  do  anything  else  but  read. 

What  did  it  all  amount  to?  Well,  look  at  the  broken  lines 
in  the  preceding  figures.  They  speak  for  themselves.  They  are 
the  graphs  of  the  same  pupils  and  the  same  grades  at  the  end  of 
the  school  year. 


PROVISION  IN  THE  HIGH-SCHOOL  CURRICULUM 
FOR  CORRECTING  PHYSICAL  DEFECTS 

Ernest  McClary  Todd 
Physical  Director,  The  Country  Day  School,  Kansas  City,  Missouri 

The  course  of  study  in  physical  education  for  secondary 
schools  may  be  constructed  to  provide  general  physical  training, 
or  to  include  both  general  and  specific  training  for  the  correction 
of  defects.  Of  these  the  first  is  the  current  objective  which  has 
been  approached  through  athletics  and  gymnasium  exercises 
of  a  general  sort.  The  second  and  more  specific  approach  has 
been  less  used;  yet  is  equally  capable  of  use  and  is  in  some  respects 
of  greater  importance. 

In  order  to  construct  a  course  of  study  in  physical  education 
with  provision  for  definite  corrective  work  and  in  order  to  put  it 
into  operation  in  the  school,  four  things  are  necessary.  There 
must  be:  first,  setting  of  standards  of  normality  so  that  deviation 
from  them  may  be  measured;  second,  determination  of  the  most 
serious  defects  common  in  the  high-school  population;  third, 
collection  of  correctives;  and  fourth,  provision  of  administrative 
machinery  so  that  the  school  program  may  permit  those  having 
common  defects  to  be  taught  at  the  same  time. 

In  the  Country  Day  School,  a  preparatory  school  for  boys,  of 
Kansas  City,  Missouri,  these  problems  have  been  attacked. 
Definite  standards  for  each  age  from  12  to  20  inclusive  were 
obtained  for  standing  height,  sitting  height,  weight,  chest  girth, 
expansion,  grip  of  right  and  grip  of  left  hand.  The  standards 
for  standing  height,  sitting  height,  weight  and  chest  girth  were 
taken  from  Porter.* 

Those  for  expansion  and  right  and  left  grip  were  obtained  by 
the  measurement  of  250  boys  of  each  age  in  central  Missouri 
schools. 

All  these  standards  were  tabulated  by  ages  and  then  arranged 
into  percentile  divisions,  as  shown  in  Tables  I  to  VII  inclusive. 

'  Porter,  W.  Townsend,  "Growth  of  St.  Louis  school  children,"  Transactions  of  the 
St.  Louis  Academy  of  Science,  6:248  ff.,  1893. 
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TABLE  I. 

STANDING  HEIGHT  (iN  INCHES) 

Age 

Percentile 

Rank 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

58.9 

61.3 

64.1 

67 

68.3 

69.7 

71.6 

74 

74.2 

90 

•  2 

57.8 

60.4 

62.6 

66.1 

67.3 

68.9 

70.8 

73 

73.5 

80 

3 

56.7 

58.8 

61.3 

64.3 

66.3 

67.9 

69.9 

72.5 

72.5 

70 

4 

55.8 

57.8 

60.3 

63 

65.1 

67 

68.7 

72.3 

72.3 

60. 

5 

55.2 

57.1 

59.3 

61.9 

64.2 

66.1 

67.9 

71.9 

71.8 

50 

6 

54.5 

56.4 

58.6 

61.1 

63.4 

65.3 

66.8 

70.4 

71 

40 

7 

53.8 

55.6 

57.6 

60 

62.7 

64.6 

65.9 

69.3 

70.7 

30 

8 

53.2 

54.9 

56.9 

59.1 

61.6 

63.7 

65 

68.5 

70.3 

20 

9 

52.4 

54 

56 

58.1 

60.6 

62.8 

64.1 

67.8 

70 

.     10 

10 

51.4 

52.8 

54.9 

56.5 

58.8 

61.7 

63.3 

66.5 

69.9 

5 

11 

50.6 

51.7 

53.9 

55.4 

57.6 

60.9 

62.4 

65.6 

68.8 

TABLE  II. 

SITTING  HEIGHT  (iN  INCHES) 

Age 

Percentile 

Rank 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

31 

31.8 

33.6 

34.8 

35.9 

37 

37.3 

38.4 

39.6 

90 

2 

30.3 

31.1 

32.6 

34 

35 

36.3 

37 

37.9 

39.3 

80 

3 

29.7 

30.5 

31.7 

33.3 

34.1 

35.4 

36.6 

37.2 

39.1 

70 

4 

29.3 

30 

31.1 

32.5 

33.7 

35 

36 

36.5 

38.9 

60 

5 

28.9 

29.8 

30.6 

31.8 

33.2 

34.6 

35.2 

35.8 

38.5 

50 

6 

28.6 

29.3 

30.1 

31.3 

32.7 

33.9 

34.5 

35.2 

38.1 

40 

7 

28.2 

28.9 

29.8 

30.8 

32.2 

33.6 

34.2 

34.8 

37.8 

30 

8 

27.9 

28.5 

29.5 

30.3 

31.4 

33.1 

33.9 

34.4 

37 

20 

9 

27.5 

28.1 

29 

29.8 

30.9 

32.4 

33.6 

34.1 

36.9 

10 

10 

26.9 

27.5 

28.2 

29.2 

30 

31.4 

33.1 

33.3 

35.2 

5 

11 

26.6 

27 

27.7 

28.6 

29.3 

30.6 

32.2 

33 

34.4 
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TABLE  II] 

[.      WEIGHT 

(in  pounds 

) 

Percentile 

Rank 

Age 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

91.1 

104.2 

118.7 

132.6 

147.7 

142.7 

156 

167 

169 

90 

2 

86.2 

95.4 

110.7 

125.6 

140.5 

140.6 

150 

160 

163 

80 

3 

81.2 

89.7 

102.9 

117.3 

129.7 

136.2 

146 

155 

159 

70 

4 

78.2 

85.5 

96.7 

110 

125.1 

132.5 

142 

149 

155 

65 

5 

75.6 

82.2 

92.3 

105 

119.9 

125.7 

137 

144 

150 

50 

6 

73.5 

79.7 

87.9 

100 

114 

121.6 

134 

139 

144 

40 

7 

71.3 

76.6 

84.7 

94.9 

108.9 

119.4 

131 

135 

140 

30 

8 

68.7 

73.9 

81.6 

90.3 

102.8 

115.5 

128 

130 

137 

20 

9 

66.1 

70.7 

78.5 

85.8 

98 

112.8 

124 

124 

132 

10 

10 

62.8 

67 

74 

81.5 

87.7 

104.3 

119 

121 

128 

5 

11 

60.4 

64.4 

70.4 

78.6 

82.9 

99.9 

112 

117 

125 

TABLE  IV. 

CHEST  GIRTH  (iN  INCHES) 

Age 

Percentile 

Rank 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

30 

31.1 

32.5 

34 

35.4 

35.4 

36 

36.8 

39.3 

90 

2 

29.3 

30.4 

31.7 

33.2 

34.5 

34.8 

35.5 

36.3 

38.7 

80 

3 

28.6 

29.4 

30.7 

32.2 

33.2 

34 

34.7 

35.7 

38.4 

70 

4 

28 

28.8 

30.2 

31.4 

32.6 

33.4 

34.4 

35.2 

37.6 

60 

5 

27.6 

28.4 

29.4 

30.8 

32 

32.7 

34 

34.8 

37.1 

50 

6 

27.2 

27.9 

28.8 

30.2 

31.4 

32.3 

33.6 

34.1 

36.5 

40 

7 

26.8 

27.5 

28.4 

29.7 

30.8 

31.9 

33.2 

33.4 

36 

30 

8 

26.4 

27 

27.9 

29 

30.1 

31.3 

32.9 

32.9 

35.4 

20 

9 

25.9 

26.6 

27.3 

28.5 

29.3 

30.7 

32.1 

32.5 

34.9 

10 

10 

25.2 

25.7 

26.6 

27.6 

28.2 

29.7 

31.4 

31.8 

34.4 

5 

11 

24.7 

25.1 

26 

26.9 

27.3 

27.9 

29.5 

31.4 

33.6 

26 
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TABLE  V. 

EXPANSION  (in  inches) 

■« 

Age 

Percentile 

Rankf 

^ 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

3.1 

3.8 

4 

5.1 

4.9 

5.1 

5.3 

5.7 

6 

90 

2 

3 

3.7 

3.8 

4.7 

4.7 

4.9 

5.1 

5.4 

5.6 

80 

3 

2.8 

3.5 

3.7 

4.6 

4.5 

4.6 

4.9 

5 

5.3 

70 

4 

2.6 

3.2 

3.5 

4.2 

4.1 

4 

4.4 

4.8 

4.9 

60 

5 

2.3 

2.8 

3.1 

3.6 

3.8 

3.4 

4.1 

4.3 

4.5 

50 

6 

2.2 

2.5 

2.6 

3.4 

3.2 

3 

3.7 

4 

4.4 

40 

7 

2.1 

2.3 

2.4 

3 

2.8 

2.9 

3.2 

3.8 

4.3 

30 

8 

2 

2.2 

2.3 

2.6 

2.4 

2.5 

2.8 

3.5 

4.1 

20 

9 

1.8 

1.9 

2.1 

2.3 

2.3 

2.3 

2.1 

3.3 

3.8 

10 

10 

1.6 

1.6 

1.8 

2 

2 

2.1 

2 

3 

3.6 

5 

11 

1.3 

1.5 

1.6 

1.8 

1.9 

1.9 

1.9 

2.8 

2.9 

.  TABLE  VI.      RIGHT  GRIP 

(in  kilograms) 

Age 

Rank 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

60 

61 

68 

100 

104 

118 

122 

138 

150 

90 

2 

59.5 

60.1 

62.9 

82 

94 

116 

120 

135 

148 

80 

3 

57 

58 

60 

73 

88 

114.2 

118 

129.1 

145 

70 

4 

54 

55 

58 

64 

87 

113.3 

116.3 

127 

143.2 

60 

5 

51 

51.7 

56 

59 

84.6 

111.1 

114 

125.6 

141.1 

50 

6 

49.1 

49.3 

49.7 

55 

83.9 

109.6 

111.4 

118.4 

140 

40 

7 

44 

45 

46 

49.1 

82 

107 

108.2 

115 

136 

30 

8 

42 

42.4 

42.7 

47 

78 

105.1 

105 

112.3 

134 

20 

9 

41 

41.2 

41.3 

44 

76.1 

104 

102.2 

109.1 

128.2 

10 

10 

38 

38.4 

38.5 

42 

75 

99.8 

98.2 

102.7 

118.9 

5 

11 

36 

36.5 

— 

36.5 

40 

74 

97 

96 

100.4 

116 
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TABLE  VII. 

LEFT  GRIP 

(in  kilograms) 

Age 

Percentile 

Rank 

12 

13 

14 

15 

16 

17 

18 

19 

20 

95 

1 

59 

59.8 

67 

99.2 

102 

115 

120 

133 

148 

90 

2 

57 

58 

62.6 

80.1 

94 

113.4 

119 

130 

146 

80 

3 

54 

54.3 

60 

70.9 

86.3 

112 

118 

126.8 

144 

70 

4 

52 

51 

58 

62 

86 

110 

116 

124.3 

142 

60 

5 

49 

49.9 

55 

58 

82 

108.9 

113 

118 

139.2 

50 

6 

48 

48.9 

49.4 

53.7 

82 

107.2 

110 

114.4 

137 

40 

7 

44 

45 

44 

48.8 

80 

104.6 

106.8 

109.4 

134 

30 

8 

42 

42.2 

42.5 

46 

78 

101.9 

104 

106 

130.1 

20 

9 

41 

41 

41.2 

43 

76 

101 

100 

104 

124.3 

10 

10 

38 

37.9 

38 

41.8 

74.8 

98.1 

98 

101.5 

117.2 

5 

11 

36 

36.4 

36.4 

39 

74 

95 

94 

100 

115 

The  95-percentile  indicates  the  upper  limit  of  rank,  the 
90-percentile,  rank  two,  and  so  forth;  so  that  in  giving  a  student 
his  standing  he  was  told  only  that  he  was  in  rank  one,  or  two,  or 
whatever  his  measurements  justified,  thus  obviating  technical 
nomenclature. 

The  division  of  standards  into  percentiles  is  of  the  greatest 
importance  for  corrective  purposes.  Obviously,  if  the  median 
is  set  as  the  standard,  then  any  student  above  median  will  feel 
that  he  has  reached  standard  and  does  not  need  to  improve, 
while  any  student  who  is  very  low  may  be  discouraged  because 
of  his  failure  to  reach  standard  immediately.  The  provision  of 
many  standards  is  vital  in  stimulating  the  student  to  try  for  the 
next  rank  above,  whether  he  be  below  or  above  the  median. 
The  steps  are  comparatively  short  and  so  easily  made  that  the 
encouragement  that  comes  from  obtaining  the  next  higher 
stimulates  enthusiasm  and  effort. 

In  addition  to  the  measurements  mentioned,  other  items  for 
which  less  definite  standards  are  necessary  were  included.  These 
were  bad  posture,  under-developed  legs,  under-developed  arms, 
abnormal  heart,  uncleanliness,  bad  teeth,  adenoids,  chronic  throat 
trouble,  deformed  feet,  and  eye  strain.  These  are  important, 
but  may  be  recognized  by  the  examiner  without  the  use  of  a 
close  standard — such  as  is  advisable  for  expansion  or  grip. 
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Perfection  in  these  seventeen  items  constitutes  the  objective 
toward  which  the  corrective  exercises  were  directed  according 
to  the  standards  for  each  age. 

It  is  obvious,  of  course,  that  some  of  the  defects  (such  as  low 
sitting  or  standing  height)  would  not  be  directly  and  in  isolation 
amenable  to  correction.  Indirectly,  however,  and  in  combina- 
tion with  other  weaknesses,  even  these  defects  may  be  improved. 
Likewise,  some  of  the  defects,  such  as  adenoids,  would  be  given 
medical  attention;  it  being  the  function  of  the  physical  director 
merely  to  call  attention  to  the  need.  The  range  of  corrective 
gymnastics  should  include  all  defects  between  those  not  attacked 
directly  and  those  yielding  only  to  medical  treatment. 

At  the  Country  Day  School,  pupils'  defects  were  determined 
each  year  by  examination.  The  primary  examination  occurred 
in  September;  and,  in  order  to  record  progress,  re-examinations 
were  made  in  January  and  in  June.  Data  cards,  one  of  which  is 
shown,  were  provided  for  each  student. 

These  cards  were  used  by  the  physical  director  and  by  the  boy 
himself  for  reference  and  record.  In  addition,  they  were  used 
in  a  more  general  way  to  provide  the  material  for  compilations 
which  served  to  arouse  and  maintain  the  interest  of  the  whole 
school  in  the  undertaking.  For  example,  there  were  compilations 
of  especially  notable  measurements  of  individuals,  of  high  averages, 
of  comparative  ranks  by  classes,  teams,  and  ages.  The  competi- 
tive instinct  was  played  upon  frankly.  If  interest  lagged,  new 
material  appeared  upon  the  bulletin  board.  By  comparisons  with 
other  schools  and  in  various  other  ways  the  strengths  as  well  as 
the  weaknesses  of  this  particular  school  population  were  brought 
forward.  While  this  necessitated  considerable  work,  particularly 
at  the  time  of  the  January  and  June  re-examinations,  the  results 
justified  it. 

Table  VIII  indicates  in  a  general  way  the  improvement  noted 
in  the  year  and  a  half  immediately  following  the  introduction 
of  the  system  into  the  Country  Day  School. 

A  very  material  climbing  into  the  higher  ranks  will  be  noticed 
between  the  September  examinations  of  each  school  year  and  the 
next  later  re-examination.  It  will  be  noticed,  too,  that  while 
the  September,  1918  percents  are  better  than  those  of  Septem- 
ber, 1917,  they  are  not  as  high  as  those  of  June,  1918.    This 
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SAMPLE  OF  DATA  CARD 


COUNTRY  DAY  SCHOOL 

Physical  Examination 


Student  A  .     B  . 
Age  15 

Class  Sophomore 

Year.     1917-18 


September 

January 

May 

Units 

Rank 

Units 

Rank 

Units 

Rank 

Standing  height  (in.) 
Sitting  height  (in.) 
Weight  (lbs.) 
Chest  girth,  (in.) 

71.4 
38.2 
146.5 
34. 

1 

1 
1 

1 

Expansion  (in.) 
Right  grip  (kg.) 
Left  grip  (kg.) 

4. 
90. 
84. 

5 
2 
2 

Aver. 

2 

Aver. 

Aver. 

Posture 
Under-developed  legs 

Under-developed  arms  Corrected  Jan. 

Heart 

Uncleanliness 

Teeth 

Adenoids 

Throat 

Eyes 

Feet  Ingrown  nails.   Corrected  Jan. 
Remarks  Permit  all  athletics.  Place  in  Class 
C.  gymnasium  to  correct  arms. 

E  .  M  .  T  .      Examiner. 


was  due,  not  to  retrogression  during  the  vacation  months,  but  to 
the  induction  of  new  boys  into  the  school. 
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TABLE   VIII.      IMPROVEMENT  IN  PHYSICAL   CHARACTERISTICS,    SEP- 
TEMBER, 1917-JANUARY,  1919 


September 
1917 

June 
1918 

September 
1918 

January 
1919 

Percent  of  boys  who  ranked 
3  or  better 

38 

44 

42 

43 

Percent  of  boys  who  ranked 
6  or  better 

65 

78 

87 

93 

Percent  of  boys  who  ranked 
9  or  better 

91 

97 

92 

96 

Percent  of  boys  who  ranked 
below  9 

8 

2 

7 

3 

The  provision  of  correctives  for  the  defects  discovered  by 
examination  is  a  comparatively  simple  matter.  This  knowledge 
is  common  in  physical  education  literature,  and  the  physical 
director  is  already  acquainted  with  it.  It  is  sufficient  here 
to  say  that  the  development  of  any  given  part  of  the  body,  and 
the  correction  of  flat  feet,  postural  faults  and  similar  defects 
are  directly  and  surely  influenced  by  physical  training;  while 
the  digestive,  nervous,  and  circulatory  systems  are  little  less 
directly  and  surely  capable  of  being  influenced. 

But  a  more  serious  task  is  the  provision  of  a  program  which 
will  permit  special  attention  to  small  groups.  This  attention  to 
small  groups  is  vital  if  the  best  corrective  work  is  to  be  done.  For 
example,  it  will  be  found  advisable  to  provide  a  curriculum  such 
that  separate  classes  in  physical  training  may  be  available  first 
for  normal  boys  (Class  A) ;  second  for  boys  who  are  organically 
and  mechanically  sound  but  who  have  poor  general  musculature 
(Class  B) ;  and  third  for  three  different  sections  of  boys  in  need  of 
special  corrective  attention  (Class  C).  For  Class  A  boys  the 
usual  athletics  may  be  used,  if  care  be  taken  to  remember  that  a 
normal  boy  is  not  necessarily  a  perfect  one,  and  that  normality 
may  not  maintain  itself  always.  For  Class  B  boys,  athletic 
games  are  beyond  doubt  needed  for  their  general  development, 
but  there  are  difficulties.  If  they  were  greatly  interested  in 
athletics  they  would  not  be  Class  B  boys,  so  usually  it  will  be 
found  wise  to  put  them  into  a  special  gymnasium  class  while 
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starting  their  development,  and  by  fostering  a  real  liking  for 
athletics,  enable  them  to  go  on  for  themselves  when  compulsion 
is  withdrawn. 

In  Class  C,  three  sections  will  be  found  advisable.  In  one 
will  be  placed  those  boys  who  are  incapacitated  for  usual  exercise 
forms,  boys  with  flat  feet,  subnormal  heart,  very  poor  expansion, 
or  crippled  permanently  or  temporarily.  This  section  should 
never  care  for  more  than  ten  pupils,  and  in  general,  not  more 
than  one  in  forty  will  be  found  belonging  here.  The  second 
section  will  include  most  boys  with  postural  faults,  those  needing 
especially  development  of  the  shoulders,  chest,  and  arms.  In  the 
third  section  may  be  placed  boys  in  need  of  specialization  in  the 
development  of  legs,  torso  (including  digestive  corrections),  and 
those  extremely  fat  or  extremely  thin.  These  two  sections  need 
not  be  limited  in  numbers. 

The  reason  for  the  necessity  of  these  divisions  is  that  other- 
wise each  boy  in  a  given  class  spends  one-third  of  his  time  correct- 
ing his  own  defects  and  two-thirds  of  his  time  doing  work  to  correct 
defects  which  he  does  not  have. 

No  sacrifice  of  academic  schedule  and  no  added  cost  are 
necessary  in  order  to  provide  for  a  course  of  study  in  physical 
education  such  as  is  needed.  It  is  only  necessary  to  arrange  the 
program  before  beginning  the  work,  in  order  to  coordinate  the 
physical  and  academic  schedules. 

The  curriculum  suggested  is  written  without  any  attempt 
to  lay  down  a  school  curriculum.  Only  those  parts  of  it  which 
relate  to  physical  education  are  advocated.  The  academic 
subjects  are  chosen  more  or  less  at  random,  the  only  care  taken 
being  to  see  that  the  number  of  subjects  listed  corresponds  to 
the  number  which  is  usual  in  high-school  courses  of  study. 

As  to  the  time  schedule,  that  one  is  purposely  chosen  into 
which  it  is  hardest  to  fit  physical  education  work.  The  schedule 
of  the  day  is  taken  to  include  forty-five  minute  periods,  beginning 
at  nine  o'clock  and  continuing  until  four,  with  an  hour  for  lunch. 
The  tendency  is  away  from  this  schedule,  but  if  the  right  kind  of 
courses  in  physical  education  can  be  fitted  into  this  old  schedule 
they  can  be  fitted  into  any. 

Three  points  are  to  be  kept  in  mind.  First,  provision  is  to 
be  made  for  the  various  divisions  previously  mentioned.     Normal 
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students  and  those  in  need  of  corrective  work  cannot  with  safety 
be  put  into  the  same  classes.  Second,  provision  is  to  be  made  for 
holding  some  of  the  physical  education  classes  during  the  school 
day.  Unless  this  is  arranged,  part  of  the  needed  instruction 
cannot  be  given;  the  work  loses  caste  by  becoming  purely  an 
after-school  activity;  the  physical  director,  who  is  supposedly  a 
specialist,  must  either  remain  idle  or  be  used  to  teach  other 
subjects  in  which  he  may  or  may  not  be  expert;  and  an  expensive 
gymnasium  and  plant  remain  idle  during  much  of  the  time. 
Third,  physical  and  academic  schedules  must  be  coordinated  to 
further  the  best  interests  of  both. 

Keeping  these  things  in  mind  and  using  the  nine  to  four  school 
day,  the  following  curriculum  for  a  four-year  high  school  is 
suggested. 

Freshman  Year 
Required  Elective 

Mathematics  I  Modern  x    igua(,cs  i 

English  I  Classical  x     euages  i 

History  i  Music 

Beginning  Gymnasium  Athletics 

Practical  Hygiene  Military  Training 

Sophomore  Year 
Required  Elective 

Mathematics  ii  History  ii 

English  II  Classical  Languages  ii 

Gymnasium  Modern  Languages  ii 

Music 

Manual  Training 
Science 

Athletics  ^■ 

Military  Training 

Junior  Year 
Required  Elective 

Mathematics  iii  History  in 

English  III  Classical  Languages  iii 

At  least  one  physical  Modern  Languages  in 

education  elective  Music 

Science 
Agriculture 
Manual  Training 
.  Military  Training 

Athletics 
Advanced  Gymnasium 
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Senior  Year 
Required  Elective 

English  IV  Mathematics  iv 

At  least  one  physical  education         History  iv 
elective  Classical  Languages  iv 

Modern  Languages  iv 
Music 
AgriciUture 
Science 
Athletics 
Manual  Training 
Military  Training 
Advanced  Gymnasium 

It  is,  of  course,  understood  that  individual  schools  will  have 
their  own  regulations  regarding  certain  of  these  electives  whether 
required  singly  or  in  groups.  Whatever  these  conditions  are,  it 
is  maintained  that  a  school  can  continue  to  use  the  usual  four 
major  sut  'ects  and  the  usual  minors  and  still  have  room  in  the 
cu     culum  ior^f' ■  ;^eal  course  of  physical  training. 

Practical  ^'  /gierie  takes  up  only  three  periods  a  week;  the 
military  training,  if  given,  two  periods  a  week,  plus  a  Saturday 
morning  session,  which  many  schools  omit  as  unnecessary. 
Athletics  come  after  school  hours;  and  the  remaining  work  fits 
into  the  schedule  without  friction.  Not  even  a  curtailment  of 
study  periods,  which  would  be  justified  if  needed  to  keep  a  boy 
fit,  is  necessary.     Three  sample  programs  show  proof  of  this. 

SAMPLE  PROGRAMS 
I.      FRESHMAN  BOYS.   CLASS  C.   CORRECTIVE 


Period 

9-9:45 

9:45-10:30.. 
10:30-11:15. 
11:15-12.... 

12-1 

1-1:45 

1:45-2:30... 
2:30-3:15... 

3:15-4 

4-5:30 


Monday 

Tuesday 

Mathematics 

Mathematics 

Gym 

Study 

English 

English 

Study 

Study 

Lunch 

Lunch 

Latin 

Latin 

Study 

Study 

History 

History 

Hygiene 

Military 

Athletics 

Athletics 

Wednesday 


Thursday 


Friday 


Saturday 


Mathematics 

Gym 

English 

Study 

Lunch 

Latin 

Study 

History 

Hygiene 

Athletics 


Mathematics 

Study 

English 

study 

Lunch 

Latin 

Study 

History 

Military 

Athletics 


Mathematics 

Gym 

English 

Study 

Lunch 

Latin 

Study 

History 

Hygiene 

Athletics 


Military? 
Military? 
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II.      SOPHOMORE  BOYS.   CLASS  A.   NORMAL 


Period 

Monday 

Tuesday 

Wednesday 

Thursday 

Friday 

Saturday 

9-9:45 

Mathematics 

Mathematics 

Mathematics 

Mathematics 

Mathematics 

Military? 

9:45-10:30.. 

Study 

Study 

Study 

Study 

Study 

Military? 

10:30-11:15. 

Gym 

Boxing 

Gym 

Boxing 

Study 

11:15-12... 

English 

English 

English 

English 

English 

12-1 

Lunch 

Lunch 

Limch 

Lunch 

Lunch 

1-1:45 

History 

History 

History 

History 

History 

1:45-2:30 

Study 

Study 

Study 

Study 

Study 

2:30-3:15... 

French 

French 

French 

French 

French 

3:15-4 

Study 

Military 

Study 

Military 

Study 

4-5:30 

Athletics 

Athletics 

Athletics 

Athletics 

Athletics 

III. 

JUNIOR  BOYS.    CLASS  B.   POOR  GENERAL  MUSCULATURE 

Period 

Monday 

Tuesday 

Wdnesday 

Thursday 

Friday 

Saturday 

9-9:45 

English 

English 

English 

English 

English 

Military? 

9:45-10:30.. 

Study 

Study 

Study 

Study 

Study 

Military? 

10:30-11:15. 

Mathematics 

Mathematics 

Mathematics 

Mathematics 

Mathematics 

11:15-12.... 

Agriculture 

Agriculture 

Agriculture 

Agriculture 

Agriculture 

12-1 

Lunch 

Lunch 

Lunch 

Lunch 

Lunch 

1-1:45 

Study 

Study 

Study 

Study 

Study 

1:45-2:30... 

French 

French 

French 

French 

French 

2:30-3:15... 

Gym 

Study 

Gym 

Study 

Gym 

3:15-4 

Mech.  D. 

Military 

Mech.  D. 

Military 

Mech.  D. 

4-5:30 

Athletics 

Athletics 

Athletics 

Athletics 

Athletics 

The  course  of  study  in  physical  training,  except  in  cases 
where  the  school  is  so  large  that  sections  of  classes  must  be 
duplicated,  is  such  that  it  may  be  handled  by  one  man. 

rV.      TEACHEH's  program   of  physical  WORK  FOR  HIGH   SCHOOL 


Period 

Monday 

Tuesday 

Wednesday 

Thursday 

Friday 

Saturday 

9-9:45 

Corr.  Gym  1 

Corr.  Gym  1 

Corr.  Gym  1 

Military? 

9:45-10:30.... 

Corr.  Gym  2 

Tumbl. 

Corr.  Gym  2 

Tumbl. 

Corr.  Gym  2 

Military? 

10:30-11:15... 

Adv.  Gym 

Boxing 

Adv.  Gym 

Boxing 

Adv.  Gym 

11:15-12 

Begn.  Gym 

Wrestling 

Begn.  Gym 

Wrestling 

Begn.  Gym 

12-1 

Lunch 

Lunch 

Lunch 

Lunch 

Lunch 

1-1:45 

1:45-2:30 

Corr.  Gym  3 

Corr.  Gym  3 

Corr.  Gym  3 

2:30-3:15 

Class  B  Gym 

Class  B  Gym 

Class  B  Gym 

3:15-4 

Hygiene 

Military 

Hygiene 

Military 

Hygiene 

4-5:30 

Athletics 

Athletics 

Athletics 

Athletics 

Athletics 

This  program,  as  it  stands,  may  be  lightened  by  the  removal  of 
military,  and  may,  in  a  given  year,  not  need  all  the  corrective 
sections. 


th:e  retention  of  foreign  language  in  the 

HOME 

RiVERDA  Harding  Jordan 

Dartmouth  College 

The  solution  of  the  problem  of  Americanization  is  largely  de- 
pendent upon  the  early  acquisition  of  English  by  the  newly  arrived 
immigrant  as  his  ordinary  medium  of  communication.  What- 
ever strides  he  may  make  in  other  directions  toward  an  under- 
standing of  the  ways  and  customs  of  the  land  of  his  adoption,  the 
newcorner  can  hardly  be  said  to  be  ready  for  the  assumption  of  the 
duties  of  a  citizen  of  this  republic  until  he  is  decidedly  familiar 
with  the  new  language.  Accordingly,  in  order  that  he  may  se- 
cure the  necessary  familiarity  with  English,  the  utmost  time  and 
effort  of  directors  of  Americanization  are  employed  to  the  end 
that  the  immigrant  may  be  given  the  privileges  of  schools  for 
children  and  adults  in  the  daytime  or  the  evening.  Even  witb 
these  agencies,  the  question  is  not  entirely  settled  as  to  what  con- 
stitutes a  real  command  of  language  or  what  would  indicate  true 
assimilation  of  it  by  the  foreign-born. 

Teachers  of  language  are  pretty  well  agreed  that  a  proper  com- 
mand of  a  foreign  tongue  is  not  acquired  until  the  student  finds 
himself  thinking  in  the  new  medium.  If  this  be  accepted  as  a 
reasonable  test  of  the  immigrant's  assimilation  into  the  new  na- 
tional life,  what  may  be  considered  some  of  the  visible  signs  and 
outward  manifestations  of  such  ability?  Probably  the  natural 
answer  would  be  to  say  that  the  whole  question  may  be  summed 
up  in  the  statement,  "Habitual  use  of  EngHsh  in  the  everyday 
affairs  of  life."  Unfortunately,  the  ordinary  affairs  of  life  involve 
a  number  of  diverse  factors — the  life  of  the  store  and  the  work- 
shop, the  hfe  of  the  street  and  the  country,  the  life  of  the  church 
and  the  lodge,  the  life  of  the  recreation  hour,  the  life  of  the  home. 
Of  all  these  the  last  is  probably  closest  to  being  the  ultimate  test. 
Here  outside  restraints  are  laid  aside  and  the  family  meets  on  the 
most  natural  and  unconstrained  basis.  Accordingly,  the  tendency 
to  "think  aloud"  is  more  nearly  realized  in  the  home  than  else- 
where.    Moreover,  it  is  here  that  the  real  influences  of  day,  eve- 
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ning,  and  continuation  schools  are  most  directly  felt  and  applied. 
If  the  proper  inspiration  has  been  given  in  the  classroom,  the  home 
will  become  the  laboratory  for  the  practice  of  the  new  acquisition. 
Freed  from  the  fear  of  ridicule  or  the  danger  of  reprimand,  the 
family  will  use  the  meal  time  or  the  evening  recital  of  the  events 
of  the  day  as  an  opportunity  to  practice  the  English  language. 
Thus  it  will  soon  become  in  reality  the  vehicle  of  thought,  and  the 
first  and  most  important  step  toward  assimilation  will  have  been 
taken.  On  the  other  hand,  if  the  language  of  the  fatherland  con- 
tinues to  be  the  medium  of  communication  at  home,  not  only  is 
a  great  educational  opportunity  overlooked  by  the  newcomers, 
but  by  the  maintenance  of  the  foreign  atmosphere  in  the  home  the 
real  adoption  of  the  United  States  as  a  new  homeland  is  deferred, 
and,  it  is  to  be  feared,  sometimes  permanently  prevented.  The 
experience  of  the  past  three  years  has  given  ample  demonstration 
of  the  fact  that  such  conditions  exist  to  a  far  greater  degree  than 
had  before  been  supposed. 

Many  still  feel,  however,  that  such  unfortunate  conditions  are 
to  be  found  principally  in  the  congested  districts  of  our  largest  cities, 
especially  on  the  Atlantic  seaboard,  and  in  the  scattered  colonies 
known  as  "Little  Russias"  and  "Little  Italies"  which  are  found 
throughout  the  land.  They  feel  that  in  the  majority  of  communities 
where  the  foreign  element  is  not  predominant  and  the  general 
tendency  is  to  patronize  the  public  schools,  no  very  serious  result 
will  follow  even  if  the  older  members  of  the  family  do  for  a  time 
after  their  arrival  in  this  country  continue  to  speak  the  foreign 
tongue  at  home.  In  such  communities  the  principal  burden  is 
laid  upon  the  school.  The  supposition  is  that,  while  the  parents 
must  use  English  in  their  commercial  pursuits,  the  pupils  will  be- 
come so  accustomed  to  using  it  in  school  and  at  play,  that  they 
will  continue  to  speak  English  at  home.  Thus,  it  is  assumed  that 
without  any  very  conscious  or  special  effort  the  whole  family  will 
shortly  find  itself  using  English  to  the  total  displacement  of  the 
foreign  tongue.  Unquestionably,  this  has  happened  in  a  number 
of  instances  and  communities.  But  there  is  good  ground  to  be- 
lieve that,  even  where  the  public  school  has  been  an  important 
factor  in  the  community,  the  persistence  of  the  foreign  language  is 
much  more  stubborn  and  widespread  than  has  been  suspected. 
A  recent  investigation  by  the  writer  has  thrown  considerable  light 
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upon  the  situation  and  gives  food  for  thought  to  those  who  have 
been  disposed  to  stress  too  greatly  the  involuntary  transfer  of  the 
influence  of  the  school  into  the  home,  as  well  as  to  those  who  have 
felt  that  continued  residence  in  an  Americanized  community  is  in 
itself  an  earnest  of  assimilation. 

In  connection  with  a  study/  made  during  the  years  1918-1919, 
of  the  relationship  existing  between  nationality  and  progress  of 
children  in  school,  the  writer  investigated  the  cases  of  2,584 
parents  of  children  of  foreign  extraction  attending  the  public 
schools  of  Minneapolis  and  St.  Paul.  Those  children  were  included 
in  the  study  whose  parents  or  grandparents  were  born  outside  of 
the  United  States.  In  almost  all  cases  the  children  themselves  were 
native  born,  and  to  insure  as  far  as  possible  that  they  had  been  in  a 
school  environment  long  enough  to  escape  the  supposed  retarding 
influence  of  the  foreign  language  in  the  home,  children  from  only 
the  sixth,  seventh,  and  eighth  grades  were  studied.  Among 
other  questions  each  child  was  asked:  "What  language  does  your 
father  speak  at  home?"  "What  language  does  your  mother 
speak  at  home?"  "What  language,  besides  English,  can  you 
speak?"  "What  language,  besides  English,  can  you  understand?" 
"How  long  has  your  father  ]^een  in  the  United  States?"  "Your 
mother?"  The  birthplace  of  father,  mother,  and  child  were  re- 
quested. In  considering  the  results,  one  must  remember  that 
these  were  public  school  children  in  schools  where  English  had 
been  continuously  the  language  of  instruction;  that  they  were 
children  at  least  eleven  years  of  age;  and  that  they  were  interro- 
gated during  the  period  of  the  war  when  the  tendency  to  indicate 
use  of  English  at  home  would  have  been  greater  than  at  any  other 
time. 

Table  I  gives  in  the  first  column  the  total  number  of  parents 
of  each  nationality  studied;  in  column  2,  the  number  who  speak 
EngHsh  as  the  language  of  the  home;  and  the  third  column  gives 
the  percent  of  column  2  to  column  1.  The  fact  that  the  Ger- 
mans head  the  list  in  acquisition  of  English  is  partially  explained 
by  the  fact  that  there  was  a  tendency  to  a  refusal  to  answer  the 
questions  or  to  answer  falsely  on  the  part  of  German-speaking 

*  Jordan,  R.  H.  Nationality  and  school  progress.  Bloomington,  Illinois:  Public 
School  Publishing  Company.    (In  press.) 
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TABLE  I.      COMPARATIVE  TABLE  OF  NATIONALITIES,  SHOWING  NUM- 
BER AND  PERCENT  OF  FOREIGN-BORN  PARENTS  WHO  HAVE 
ADOPTED  ENGLISH  AS  THE  LANGUAGE  OF  THE  HOME 


Nationality 

Total 
Parents 

Number 
Speaking 
English 

Percent 
Speaking 
English 

Bohemian 

36 

77 
396 
802 
201 
126 

63 

86 
234 
526 

37 

6 

5 

128 

265 

123 

10 

26 

1 

35 

45 

3 

16.6 

Slovakian 

6.5 

Norwegian 

32.3 

Swedish 

33.0 

German 

61.2 

Austrian 

7.9 

Danish 

41.3 

Finnish 

1.1 

Roumanian  Jew 

Russian  Jew 

15.0 

8.5 

ItaUan 

8.1 

TABLE    II.      PERSISTENCE    OF     FOREIGN    LANGUAGE    SHOWN    BY 

NUMBER  AND  PERCENT  OF    FOREIGN-BORN  PARENTS    WHO 

RETAIN   THE    FOREIGN   LANGUAGE    AS    THE    HOME 

LANGUAGE,  ALTHOUGH  THEY   HAVE  LIVED 

IN  AMERICA  TEN  YEARS    OR  MORE 


Total 
Parents 

Vears  Lived  m  the  United  States 

Nationality 

10  to  19 

20  to  29 

30  and 

more 

Number 

Percent 

Number 

Percent 

Number 

Percent 

Germany 

201 

63 

396 

802 

126 

234 

37 

36 

77 

526 

86 

14 

5 

69 

93 

30 

123 

5 

6 

22 

237 

38 

7.0 
7.9 
17.4 
11.6 
23.8 
52.6 
13.5 
16.6 
28.5 
45.0 
44.1 

9 

7 
48 

166 
23 
18 
16 
10 
20 

145 
23 

4.4 
11.1 
12.1 
20.7 
18.2 

7.7 
43.2 
27.7 
25.9 
27.5 
26.7 

22 
5 

76 

134 

12 

5 

3 

10 

18 

32 

14 

10.9 

Danish 

7.9 

Norwegian 

19.2 

Swedish 

16.7 

Austrian 

9.5 

Roumanian  Jew .... 
Italian 

2.1 
8.1 

Bohemian 

27.7 

Slovakian   

Russian  Jew 

Finnish 

23.3 

6.1 

16.2 
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children.  In  two  cases  the  child  replied:  "I  don't  want  to  tell!" 
How  far  this  affects  the  result  is  a  question.  In  the  mind  of  the 
writer  the  effect  would  not  be  very  great,  probably  not  great 
enough  to  displace  the  German  group  from  its  position  of  primacy. 
The  entire  significance  of  the  table  is  not  understood  until  it  is 
studied  in  connection  with  Table  II.  Here  again  we  have  in  col- 
umn 1  the  total  number  studied;  in  column  2  the  number  who  have 
lived  in  this  country  from  ten  to  nineteen  years,  inclusive,  and 
who  still  speak  the  foreign  language  at  home;  column  3  shows  the 
percent  of  these  to  the  total;  columns  4  and  5  give  the  same 
data  for  those  who  have  lived  in  this  country  from  twenty  to 
twenty-nine  years,  inclusive;  and  columns  6  and  7  for  those  who 
have  lived  here  thirty  years  or  longer.  Figures  1  and  2  show 
graphically  the  same  facts  as  Tables  I  and  II. 

When  we  note  that  only  one  Finn  out  of  86  uses  English  as  the 
home  tongue  and  that  75  of  these  Finns  have  lived  in  this  country 
ten  years  or  longer,  we  must  confess  that  the  influence  of  the  gen- 
eral environment  of  the  public  school  and  of  the  social  and  com- 
mercial requirements  of  the  city  have  not  been  extremely  effective 
since  they  have  permeated  the  home  to  no  greater  extent  than 
is  indicated.  In  the  same  way  the  tables  show  that  5  of  77  Slovaks 
speak  English  at  home,  although  60  of  the  77  have  lived  here  at 
least  ten  years;  and  that  of  802  Swedes  393,  or  49  percent  have 
lived  here  ten  years,  but  speak  Swedish  at  home.  The  last  column 
of  Table  II  is  even  more  significant.  When  28  percent  of  the 
Bohemians,  19  percent  of  the  Norwegians,  17  percent  of  the 
Swedes,  11  percent  of  the  Germans  have  lived  in  this  country 
30  years  or  longer — most  of  them  continuously  in  a  predominantly 
English-speaking  community^  with  every  opportunity  to  acquire 
the  new  language — and  when  these  families  have  not  felt  the 
need  of  using  English  at  home,  the  conclusion  is  forced  that  a 
much  more  vital  factor  is  required  than  has  been  applied  in  the 
past  in  order  to  secure  this  basic  element  of  Americanization. 
Some  individual  cases  are  even  more  startling:  two  Swedes,  one 
German,  one  Finn,  and  one  Russian  have  lived  in  this  country 
fifty  years  and  still  speak  the  foreign  language  in  the  home  circle ! 

2  The  United  States  census  of  1910  showed  that  28.5  percent  only  of  the  popula- 
tion of  Minneapolis  and  26.3  percent  of  the  population  of  St.  Paul  were  foreign-born. 
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Six  Norwegians  and  five  Swedes  have  been  here  forty-five  years 
or  more  but  do  not  speak  English  at  home. 

•In  Table  III  a  still  more  serious  situation  is  found,  for  this 
table  gives  the  data  for  125  parents  who  were  themselves  born  in 
this  country,  but  who  speak  the  foreign  language  as  the  home 
medium. 


TABLE  III.      DISTRIBUTION  OF  PARENTS  BORN  IN  THE  UNITED  STATES 
WHO  SPEAK  A  FOREIGN  LANGUAGE  HABITUALLY  AT  HOME 


Nationality 

Father 
Only 

Mother 
Only 

Both 

Total 
Parents 

Bohemian 

Slovakian 

Norwegian 

Swedish 

German 

Finnish 

Russian  Jew 

1 
0 
3 
7 
2 
2 
2 
3 

6 

4 
14 
19 

8 
4 
2 
4 

0 
0 
6 
9 

5 
2 
0 
0 

7 
4 
29 
44 
20 
10 
4 

French  Canadian 

7 

Total 

20 

61 

22 

125 

In  nine  Swedish  families,  six  Norwegian,  and  five  German, 
both  parents  were  born  in  the  United  States  but  do  not  speak 
English  at  home !  The  tendency  of  the  mothers  to  make  the  lan- 
guage of  their  mothers  the  domestic  language  is  shown  by  the 
greater  number  of  the  native-born  mothers  who  use  the  foreign 
language,  than  of  the  fathers.  The  potent  factor  in  most  of  these 
cases  is  the  presence  in  the  home  of  a  foreign-born  grandfather 
or  grandmother  who  has  never  learned  English;  but  this  factor 
certainly  should  not  go  farther  than  to  make  necessary  a  type  of 
bihnguality  which  is  in  large  part  excusable.  The  comparative 
influence  of  the  mother  in  determining  the  home  atmosphere  is 
brought  out  very  definitely  by  this  table.  The  whole  situation  is 
more  clearly  presented  to  us  when  cases  of  individual  homes  are 
examined.  In  one  case,  a  Norwegian-born  husband  married  an 
American-born  wife,  and  although  the  husband  has  lived  here  for 
35  years,  both  speak  Norwegian  in  the  home  circle.  Another 
case  is  exactly  similar  save  that  the  husband  has  been  here  but 
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29  years.  An  American-born  husband,  of  American-born  par- 
ents married  a  Norwegian-born  wife;  he  speaks  English  at  home 
but,  despite  her  thirty  years'  residence  here,  his  wife  clings  to 
Norwegian  as  the  home  tongue.  Another  American-born  hus- 
band is  more  complaisant;  and  since  his  Swedish-born  wife  in  her 
thirty-four  years'  life  here  has  not  acquired  English,  he  also  speaks 
Swedish  at  home.  A  Norwegian-born  husband  has  a  Scotch-born 
wife;  he  has  lived  here  for  45  years  but  both  of  them  speak  Nor- 
wegian at  home.  A  Swiss  husband  has  been  here  31  years,  and 
his  Austrian  wife  for  28  years;  they  speak  German  as  the  fireside 
language.  An  Irishman  married  a  Minneapolis-born  girl  whose 
father  was  born  in  France  and  whose  mother  was  born  in  Germany. 
He  speaks  English  at  home,  but  she  speaks  German.  In  two  out 
of  three  cases  where  a  Swedish  husband  has  a  Norwegian  wife, 
Swedish  is  spoken  at  home,  but  in  the  third  case,  the  wife  was 
dominant,  and  they  have  "compromised  on  Norwegian." 

Thus,  under  the  very  favorable  situation  existing  in  Minne- 
apolis and  St.  Paul,  only  from  20  to  25  percent  of  our  immigrants 
have  adopted  English  as  the  home  language  and  more  than 
one-half  have  not  come  to  use  English  at  home  after  living  here 
for  ten  years  or  longer.  The  result  of  the  foregoing  study  is  to 
show  that  if  this  is  true,  the  need  for  a  new  method  of  attacking 
the  problem  is  manifest,  or  we  shall  have  a  growing  tendency  to 
continue  the  foreign  language  even  to  the  later  generations  of  the 
native  born.  The  problem  is  probably  not  one  primarily  of  the 
public  school.  Very  probably  it  should  fall  rather  under  the  gen- 
eral head  of  the  problems  of  Americanization  and  of  naturaliza- 
tion, and  so  rather  become  a  social  and  legislative  matter. 

Legislative  and  other  methods  of  insuring  that  English  be 
the  language  of  instruction  in  all  schools  will  surely  help  to  solve 
the  problem,  but  the  study  sets  forth  clearly  that  there  is  a  further 
need  to  be  met.  More  carefully  drawn  naturalization  laws  will 
be  in  part  effective.  Equal  suffrage,  in  bringing  to  many  of  the 
immigrant  women  the  desire  to  acquire  the  rights  of  citizenship, 
will  be  in  time  a  strong  element  in  forcing  many  women  to  learn 
the  new  language.  A  changed  attitude  on  the  part  of  pastors  and 
editors  toward  their  foreign-born  constituencies  must  also  be 
effected.  Sermons  preached  in  English  and  local  papers  printed 
in  English  will  have  a  powerful  effect. 
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By  way  of  summary,  it  may  be  said  that  if  the  condition 
pointed  out  in  the  above  study  is  to  be  met  effectively,  it  must  be 
done  by  the  development  of  a  social  consciousness  on  the  part  of 
the  immigrant.  He  must  learn  that  to  be  a  good  citizen  of  the 
new  homeland  he  must  speak  English  at  home,  attend  sermons 
preached  in  EngHsh,  and  read  papers  printed  in  English.  All  of 
these  things  must  be  considered  as  a  prerequisite  to  his  ability  to 
cast  his  ballot  in  an  American  election — a  privilege  which  should 
stand  to  him  as  the  crowning  attribute  of  citizenship,  the  final 
proof  of  his  complete  assimilation  as  an  American. 


GROUP  INTELLIGENCE  TESTS  AS  A  MEANS  OF 
PROGNOSIS   IN  HIGH   SCHOOL 

I.  N.  Madsen 
State  Normal  School,  Lewiston,  Idaho 

In  this  article  data  are  submitted  showing  the  possibilities  of 
using  the  Alpha  Army  Intelligence  Test  as  a  means  of  prognosis 
in  high  school.  This  test  was  given  to  about  one  and  a  half  million 
men  in  the  army  and  became  available  for  public  use  at  the  close 
of  the  war.  It  consists  of  eight  sub-tests,  and  the  maximum  pos- 
sible score  is  212.  The  scores  were  interpreted  by  the  army  psy- 
chologists as  follows: 


Score 

Rating 

Interpretation 

135-212 

A 

Very  superior  intelligence. 

105-134 

B 

Superior  intelligence. 

75-104 

c-i- 

High  average  intelligence. 

45-  74 

c 

Average  intelligence. 

25-  44 

c- 

Low  average  intelligence. 

15-  24 

D 

Inferior  intelligence. 

0-  14 

D- 

Very  inferior  intelligence. 

The  conclusions  of  the  present  study  are  based  on  the  results 
obtained  from  the  high  schools  at  Madison,  Wisconsin;  Rockford, 
Illinois;  and  Sioux  City,  Iowa;  and  from  three  high  schools  at 
Omaha,  Nebraska,  namely.  Central,  Commerce,  and  South.  The 
test  was  given  at  Madison,  Rockford,  and  Sioux  City  in  May,  1919 
and  at  Omaha  during  the  second  semester  of  the  year  1919-1920. 
The  total  number  of  students  taking  the  tests  in  these  six  high 
schools  was  7,168,  distributed  as  shown  in  Table  I.  The  conclu- 
sions are  summarized  in  the  remaining  tables. 

According  to  Table  II,  which  relates  only  to  the  results  secured 
at  Madison,  Rockford,  and  Sioux  City,  only  8  students  of  the  3,703 
tested  fell  below  a  score  of  45  or  "average  intelligence."  These 
eight  were  all  in  the  freshman  and  sophomore  classes.  This  indi- 
cates that  more  than  average  intelligence  is  necessary  to  enable 
students  to  enter  these  high  schools.  This  agrees  with  the  con- 
clusions of  Dr.  Terman  in  his  discussion  of  the  "Significance  of 
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TABLE  I.     THE  NUMBER  OF  STUDENTS  BY  SCHOOL,  CLASS,  AND  SEX 
ON   WHICH   THE   STUDY  IS   BASED 


Madi- 
son 

Rock- 
ford 

Sioux 
City 

Omaha 

Total 

Central 

Com- 
merce 

South 

Senior  boys 

Senior  girls 

Junior  boys 

Jimior  girls 

Sophomore  boys  . . . 
Sophomore  girls  . . . 

Freshman  boys  .... 
Freshman  girls  .... 

62 
103 

80 
141 

121 
175 

140 

174 

111 
149 

166 

183 

186 

182 

235 
265 

69 
141 

88 
162 

135 
192 

208 
235 

128 
152 

151 
190 

184 
235 

280 
331 

63 
82 

97 

147 

133 
217 

268 
379 

22 

47 

28 
46 

33 
49 

84 
119 

455 
674 

610 

869 

792 
1,050 

1,215 
1,503 

Totals 

996 

1,477 

1,230 

1,651 

1,386 

428 

7,168 

TABLE   II.    SCORES  OF  THREE  HIGH  SCHOOLS  (mADISON,  ROCKFORD, 
AND  SIOUX  city)  IN  THE  ARMY  GROUP  TEST  ALPHA 
BY  SEX  AND  CLASS 


Boys 



Girls 

2 

V^ 

Grand 

Score 

o 

.2 
'S 

1-1 
o 
*3 

o 

a 

a. 

1 

1 

o 
"3 

hi 
o 

"3 

1 

•a 

f> 

3 

Total 

^ 

A 

o 

i^ 

3 
>— » 

o 

fe 

^ 

135  and  over 

A 

120 

129 

89 

56 

394 

120 

134 

80 

33 

367 

761 

105-134 

B 

88 

141 

208 

205 

642 

206 

257 

234 

219 

916 

1,558 

75-104 

c+ 

30 

60 

119 

258 

457 

63 

92 

207 

323 

685 

1,152 

45-  74 

c 

4 

4 

25 

61 

94 

4 

3 

27 

96 

130 

224 

25-  44 

c- 

0 

0 

0 

3 

3 

0 

0 

1 

3 

4 

7 

15-  24 

D 

0 

0 

1 

0 

I 

0 

0 

0 

0 

0 

1 

0-  14 

D- 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Totals 

242 

334 

442 

583 

1,601 

393 

486 

549 

674 

2,102 

3,703 
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Various  Intelligence  Quotients"^  where  he  says,  with  reference 
to  average  intelligence  in  terms  of  the  Stanford-Binet  tests,  that 
"the  high  school,  however,  does  not  fit  their  grade  of  intelligence 
as  well  as  the  elementary  and  grammar  schools."  The  high-school 
students  are  thus  seen  to  represent  a  relatively  high  grade  of  in- 
telligence. From  Table  III  it  will  be  seen  that  selection  of  the 
mentally  superior  continues  through  the  four  years  of  high  school. 
Thus,  according  to  the  medians,  seniors  stand  higher  than  the 
juniors,  the  juniors  surpass  the  sophomores,  and  the  sophomores 
outrank  the  freshmen.  This  is  true  for  the  sexes  separately  as  well 
as  for  the  classes  as  a  whole.  This  means  that  a  large  number  of 
high-school  students  are  eliminated  because  they  lack  the  mental 
ability  to  meet  the  requirments  of  the  work  offered.  How  to  pro- 
vide for  the  individual  capacities  is,  of  course,  a  problem  school 
administrators  have  worked  on  for  many  years.  With  the  per- 
fection of  intelligence  tests  we  may  hope  that  the  problems  will 
become  easier  to  solve  through  knowledge  of  the  degree  of  intelli- 
gence required  for  success  in  the  various  types  of  school  work. 

TABLE  III.      COMPARISON  OF  MEDIAN  SCORES  IN  THE  ALPHA  ARMY 
TEST  IN  SIX  HIGH  SCHOOLS  BY  SEX  AND  CLASS 


Madison 

ROCK- 
PORD 

Sioux 
City 

Omaha 

Central 

Commerce 

South 

Senior  boys 

Senior  girls 

Whole  class 

Junior  boys 

Junior  girls 

Whole  class 

Sophomore  boys  .  .  . 
Sophomore  girls  . .  . 
Whole  class 

Freshman  boys  .... 
Freshman  girls  .... 
Whole  class 

130.0 
117.9 
121.2 

124.0 
121.4 
122.4 

114.4 
104.4 
109.7 

100.0 
93.0 
96.0 

129.3 
119.8 
123.8 

124.6 
112.2 
119.7 

108.7 
104.7 
107.0 

94.1 
89.8 
94.0 

140.8 
134.7 
137.6 

136.2 
128.0 
130.2 

125.5 
118.7 
122.1 

111.6 
105.0 
107.9 

143.0 
132.5 
135.0 

134.0 
130.5 
132.0 

125.0 
121.0 
122.0 

107.0 
107.0 
107.0 

113.1 
109.7 
110.8 

108.0 

97.8 

101.8 

99.5 
88.9 
93.8 

85.4 
84.0 
84.5 

126.7 
104.5 
110.0 

118.8 
117.8 
118.3 

107.1 
118.5 
113.6 

102.1 
87.5 
92.9 

'  Terman,  Lewis  M. 
MiflBin  Company,  1919. 


The  intelligence  of  school  children.     Boston:  Houghton 
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It  will  also  be  observed  that  according  to  Table  III  significant 
differences  appear  in  the  median  scores  made  by  the  students  of 
the  six  high  schools.  In  an  earlier  study, ^  the  writer  remarked 
on  the  superiority  of  scores  made  in  the  Sioux  City  high  school 
over  the  Madison  and  Rockford  scores.  No  satisfactory  expla- 
nation was  found.  In  this  table  striking  differences  are  also  shown 
between  the  three  Omaha  high  schools:  Central  ranking  first,  South 
ranking  second,  and  Commerce  ranking  third.  In  order  to  throw 
further  light  on  this  situation,  the  writer  made  a  comparison  of  the 
occupations  and  nativity  of  the  parents  of  the  students  of  these 
three  high  schools.  By  "parent"  is  meant  the  father  if  living;  the 
mother,  if  the  father  is  dead;  and  the  guardian  if  both  parents  are 
dead.  The  results  appear  in  Tables  IV  and  V.  The  occupations 
were  classified  in  the  following  manner:  (1)  professional:  artists, 
clergymen,  engineers,  lawyers,  physicians  and  dentists,  teachers; 
(2)  business:  bankers,  builders  and  contractors,  manufacturers, 
real  estate;  (3)  public  service:  city,  county,  state,  and  other  officials; 
(4)  trades :  bakers  and  confectioners,  butchers,  machinists,  printers, 
etc.;  (5)  clerical:  bookkeepers,  salesmen,  etc.;  (6)  personal  services: 
agents,  boarding  housekeepers,  hotel  employees,  housekeepers, 
milkmen,  peddlers,  seamstresses,  street  railway  employees,  etc.; 
(7)  laborers :  liverymen,  teamsters,  unskilled  labor;  (8)  unclassified : 
occupations  not  given. 

TABLE  IV.     COMPARISON  OP  OCCUPATION  OF  PARENTS  OF  THE  STU- 
DENTS OF  THE  OMAHA  CENTRAL,  SOUTH,  AND  COM- 
MERCE HIGH  SCHOOLS 


Central^H.'S.    [ 

Commerce  H.  S. 

South  H.  S. 

Number 

Percent 

Number 

Percent 

Number 

Percent 

Professional 

Business  men 

Public  service 

Trades 

226 
754 

74 
227 
184 
413 

48 
169 

11.1 
35.6 

3.5 
11.1 

8.6 
19.6 

2.5 

8.0 

43 
274 

47 
228 
113 
278 

93 
118 

3.8 
23.0 

4.0 
19.2 

9.5 
23.5 

8.0 

9.0 

33 

116 

14 

32 
14 
67 
88 
192 

6.0 

20.4 

2.5 

6.0 

Clerical 

2.5 

Personal 

12.0 

Laborers 

16.1 

Unclassified 

34.5 

Total 

2,095 

100.0 

1,194 

100.0 

556 

100.0 

*  Madsen,  I.  N.  and  Sylvester,  R.  H.    "High  school  students'  intelligence  ratings 
according  to  the  Alpha  army  test,"  School  and  Society,  10:407-10,  October  4, 1919. 
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TABLE  V.     COMPARISON  OF  NATIVITY  OF  PARENTS  OF  THE  STUDENTS 

OF  THE  OMAHA  CENTRAL,  SOUTH,  AND  COMMERCE  HIGH 

SCHOOLS 


AnfRRicAN  Born 

Foreign  Born 

Number 

Percent 

Number 

Percent 

Central  High  School 

Commerce  High  School .  . . 
South  High  School 

1,519 
692 
329 

71 
51 
59 

617 
669 
227 

29 
49 
41 

It  will  be  seen  from  Table  IV  that  there  is  a  distinct  difference 
in  the  constituency  of  the  three  high  schools,  Central  High  draw- 
ing more  largely  from  the  upper  and  middle  classes.  South  High 
ranking  second  in  this  respect,  and  Commerce  ranking  last. 
Central  is  the  oldest  high  school  of  the  city  and  is  of  the  classical 
type.  Commerce,  as  the  name  indicates,  provides  training  in 
commerce  and  other  vocational  courses.  South  High  is  the  small- 
est of  the  three  and  is  a  cosmopolitan  school  but  with  about  half 
of  its  students  in  commercial  and  vocational  courses.  From  Table 
V  it  will  be  seen  that  there  is  also  a  distinct  difference  in  the  na- 
tivity of  the  parents  of  the  students  of  the  three  schools,  Central 
having  the  smallest  proportion  of  foreign-born  parents,  South 
ranking  second,  and  Commerce  third.  These  facts  again  point  to 
the  serviceableness  of  the  Army  test  as  a  measure  of  intelligence. 
There  is  substantial  agreement  between  the  intelligence  scores  of 
the  high-school  students  and  their  social  origin. 

A  very  significant  fact  appears  from  Table  VI,  namely,  the 
superiority  of  the  younger  students  in  each  class  over  the  older 
students  in  the  same  class.  Thus  the  median  score  for  the  twelve- 
year-old  freshmen  is  125.0,  for  the  thirteen-year-old  freshmen, 
109.7,  etc.,  with  a  substantial  and  consistent  decrease  in  score  with 
increase  in  age  to  a  score  of  50.0  for  the  eighteen-year-old  fresh- 
men. The  same  fact  holds  for  the  other  three  classes.  This  is  ex- 
actly what  would  be  expected  if  the  Alpha  Army  Test  really 
measures  native  intelligence.  Logically,  one  would  expect  a 
twelve-year-old  who  has  reached  the  freshman  class  to  be  mentally 
superior  to  the  older  students  in  the  same  class.  The  difference 
cannot  be  due  to  educational  experience  for  the  twelve-year-old 
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TABLE  VI.      COMPARISON  OF  MEDIAN  SCORES  IN  THE  ALPHA  ARMY 
TEST  BY  AGES  AND  BY   CLASSES  IN  THE  MADISON,  ROCK- 
FORD,  AND  SIOUX  CITY  HIGH  SCHOOLS 


Age 

12 

13 

14 

15 

16 

17 

18 

19 

20 

125.0 

109.7 
125.0 

103.3 
121.9 
130.0 

97.2 
114.4 
128.7 
145.0 

90.3 
113.3 
127.3 
141.4 

87.0 
103.7 
121.5 
130.3 

50.0 
105.0 
114.1 
125.8 

Sophomore 

95.0 
100.0 
117.8 

Junior 

Senior 

107.5 

TABLE  VII. 


CORRELATION  OF  INTELLIGENCE  WITH   SCHOOL   MARKS 
IN  THE  SOUTH  OMAHA  HIGH  SCHOOL 


Number  of 

f 

Students 

Freshman  boys 

0.27 

84 

Freshman  girls 

0.37 

119 

Sophomore  boys 

0.42 

33 

Sophomore  girls 

0.36 

49 

Junior  boys 

0.38 

28 

Junior  girls 

0.50 

46 

Senior  boys 

0.51 

22 

Senior  girls 

0.36 

47 

has  ordinarily  not  been  in  school  as  long  as  his  older  classmates. 
The  likelihood  is  much  stronger  that  the  reverse  is  true.  The  older 
freshman  has  also  the  advantage  of  more  years  in  which  to  secure 
incidental  information,  which  should  help  him  in  making  a  high 
score  if  educational  experience  is  a  factor.  Another  significant 
fact  appearing  from  Table  VI  is  that  for  any  given  age  there  is  an 
increase  in  score  by  the  sophomores  over  the  freshmen,  by  the 
juniors  over  the  soph<3mores,  and  by  the  seniors  over  the  juniors. 
For  example,  for  age  fifteen,  the  median  score  of  the  freshmen  is 
97.2;  of  the  sophomores,  114.4;  of  the  juniors,  128.7;  and  of  the 
seniors,  145.0.    This  also  accords  with  the  logic  of  the  situation. 
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If  the  Army  test  really  measures  intelligence,  then  for  a  given  age, 
the  students  in  the  higher  classes  would  secure  the  highest 
scores. 

Table  VII  shows  the  correlation  of  intelligence  with  school 
marks.  The  school  marks  were  obtained  from  South  High  School 
by  taking  the  average  of  each  student's  marks  at  the  end  of  the 
first  semester,  1919-1920.  Pearson's  formula  was  used  for  finding 
the  coefl&cients  of  correlation.  It  will  be  seen  that  the  correlations 
are  all  positive  and  large  enough  to  be  significant.  Several  reasons 
may  be  given  why  they  are  not  larger.  In  the  first  place,  the  in- 
accuracy of  school  marks  as  shown  by  recent  investigations  would 
reduce  the  correlations  below  their  true  value.  A  second  cause  is 
the  shifting  standard  of  marking.  The  standard  tends  to  be  too 
high  where  intelligence  is  unusually  high  and  too  low  where  it 
is  unusually  low.  This  is  inevitably  the  case  where  marking  is 
based  on  the  normal  distribution  curve  for  the  particular  school. 

TABLE    VIII.       NUMBER    OF    SUBJECTS    CARRIED    BY    SOUTH    HIGH- 
SCHOOL  STUDENTS  WHO  BELONGED  TO  THE  LOWEST  AND 
HIGHEST  QUARTERS   OF  THEIR  CLASSES   (ACCORDING 
TO  THE  ARMY  TEST) 


Subject 

Taken  by 

Freshmen 

Taken  by  Sophomores, 
Juniors,  and  Seniors 

Highest 
Quarter 

Lowest 
Quarter 

Highest 
Quarter 

Lowest 
Quarter 

English 

50 

6 

22 

19 

20 

7 
22 

40 

4 

14 

7 
9 

1 
34 

42 
9 
16 
21 
16 
2 

39 

French 

2 

History 

21 

Latin 

11 

Mathematics 

17 

Spanish 

0 

Penmanship  and  spelling . . 

Physics 

14 

5 

12 

19 

7 

7 

10 

9 

Reviews 

10 

Shorthand 

14 

Typewriting 

27 

Chemistry 

3 

Cooking 

11 

Commercial  arithmetic. . . . 

15 
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Table  VIII  also  indicates  a  correlation  between  intelligence 
and  school  work.  The  question  occurred  to  us  whether  there 
would  be  any  differences  in  subjects  chosen  by  the  students  scoring 
high  and  those  scoring  low  in  the  army  test.  To  determine  this, 
the  students  scoring  above  the  upper  quartile  and  those  scoring 
below  the  lower  quartile  were  compared.  For  this  purpose  the 
students  of  South  High  were  used.  The  freshman  class  was  scored 
separately  and  the  three  upper  classes  were  combined  because  of 
the  smallness  of  their  numbers.  In  the  freshman  class  there  were 
50  students  (21  boys  and  29  girls)  in  the  highest  quarter  of  the 
class,  and  of  course  the  same  number  in  the  lowest  quarter.  In 
the  three  upper  classes  there  were  60  students  (25  boys  and  35 
girls)  in  the  superior  group  and  also  in  the  inferior  group.  There 
appears  to  be  a  marked  tendency  for  the  superior  group  in  both 
cases  to  select  the  subjects  usually  considered  "hard,"  and  for  the 
inferior  group  to  select  vocational  or  prevocational  subjects.  This 
tendency  is  prevented  from  full  expression  by  certain  fixed  re- 
quirements and  by  the  lack  of  "sophistication"  among  the  students. 
How  shall  we  interpret  these  facts?  Does  intelligence  tend  to 
seek  its  proper  level?  Do  the  mentally  superior  select  the  more 
academic  subjects  because  they  find  them  mentally  "stimulating" 
or  because  of  college  and  professional  preparation? 

Persistent  and  important  sex  differences  are  found  in  scores 
made  in  the  Army  mental  tests.  In  every  one  of  the  six  high 
schools,  the  median  score  for  boys  in  each  class  was  higher  than 
the  median  score  for  girls  in  the  same  class.  (S  ee  Table  III.)  This 
sex  difference  has  also  been  found  consistently  in  universities 
where  the  test  has  been  given.  Two  reasons  have  been  proposed 
for  this  difference:  first,  that  the  boys  are  really  mentally  superior, 
and  second,  that  the  Army  test  is  a  "man's  test."  The  latter 
reason  has  been  asserted  particularly  with  reference  to  Test  8. 
This  is  a  test  of  general  information;  and  it  appears  to  be  more 
within  the  range  of  the  interests  of  men  than  of  women.  In  order 
to  determine  the  extent  to  which  each  of  the  eight  tests  contrib- 
uted to  the  differences  in  total  scores,  the  median  score  for  each  test 
and  for  the  boys  and  girls  of  each  class  at  the  High  School  of 
Commerce  was  found.    The  results  appear  in  Table  IX. 
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In  connection  with  this  table  the  reader's  attention  is  called 
to  the  following  titles  or  descriptions  of  these  eight  tests: 

1.  Comprehending  and  carrying  out  directions 

2.  Arithmetical  problems 

3.  A  test  of  common  sense 

4.  Opposites  test 

5.  Disarranged  sentences 

6.  Number  completion  test 

7.  Judgment  of  relationship 

8.  General  information  test 

From  Table  IX  it  appears  that  the  greatest  difference  was  in 
Test  8.  The  boys,  however,  surpassed  the  girls  to  some  extent  in 
every  test  except  the  fifth  (disarranged  sentences).  Although 
the  boys  did  better  than  the  girls  in  the  Army  test,  it  appears 
from  Table  X  that  the  girls  in  each  class  had  the  highest  school 
marks.  It  is  quite  possible  that  certain  emotional  traits  resulting 
in  greater  docility  enable  the  girls  to  secure  better  marks  on  a 
smaller  mental  capital  than  the  boys  need.  These  emotional 
traits  need  not  be  elaborated  upon  here  since  they  are  familiar 
to  teachers  and  educational  students  through  educational  psychol- 
ogy. 


table  ix.    sex  differences  in  tests  1  to  8  of  the  alpha  army 

test  in  the  omaha  high  school  of  commerce 

(median  scores) 


Class  and  Sex 

Test 

Number 

of 
Students 

1 

2 

3 

4 

5 

6 

7 

8 

Freshman  boys.. 
Freshman  girls. . 

Sophomore  boys. 
Sophomore  girls . 

Junior  boys 

Junior  girls 

Seniors  boys 

Senior  girls 

9 

7 

9 

8 

9 

7 

8 
8 

10 
9 

11 
9 

12 
9 

12 
9 

9 

8 

9 
9 

10 
10 

10 

11 

12 
11 

14 
13 

15 
14 

18 
18 

8 
10 

11 
10 

11 
12 

12 
14 

8.5 
8 

10 
9 

10 
9 

10 
10 

13 
14 

18 
16 

16 
16.5 

19 
19 

18 
16 

22 
18 

23.5 
21 

26 
22 

268 
379 

133 
217 

94 
147 

63 

82 
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TABLE  X.      COMPARISON  OF  MEDIAN  SCORES  IN  INTELLIGENCE  AND 
IN  SCHOOL  MARKS  IN  THE  SOUTH  OMAHA  HIGH  SCHOOL 


Class  and  Sex 

Intelligence 
Scores 

School 
Marks 

Freshman  boys 

Freshman  girls 

Sophomore  boys 

Sophomore  girls 

Junior  boys 

102.1 

87.5 

107.1 
118.5 

118.7 
117.8 

126.7 
104.5 

77.5 
83.3 

80.3 
86.0 

82.5 

Junior  girls 

86.6 

Senior  boys 

86.9 

Senior  girls 

85  5 

To  conclude,  the  present  study  may  be  summarized  as  follows : 

1.  High-school  students  are  a  highly  selected  group  mentally 
compared  with  the  general  population.  "Average  intelligence," 
as  defined  by  the  army  psychologists,  was  the  lowest  grade  of 
intelligence  in  the  high  schools  investigated. 

2.  Selection  by  elimination  of  the  mentally  inferior  continued 
throughout  the  four  years  of  high  school. 

3.  In  each  class  the  younger  students  were  superior  mentally 
to  the  older  students ;  and  accordingly,  at  a  given  age,  students  in 
upper  classes  were  superior  mentally  to  those  in  lower  classes. 

4.  Students  whose  parents  were  in  the  "higher"  and  more  re- 
munerative occupations  and  were  of  American  nativity  were 
mentally  superior  to  students  whose  parents  followed  the  more 
undesirable  occupations  and  were  of  foreign  nativity. 

5.  The  correlation  of  mentality  with  school  marks  was  positive . 

6.  There  was  a  difference  in  the  subjects  of  study  elected  by 
the  mentally  superior  and  the  mentally  inferior, 

7.  Sex  differences  were  indicated  by  a  higher  median  intelli- 
gence score  for  the  boys  than  for  the  girls. 

8.  In  each  class  the  girls,  in  spite  of  lower  intelligence  scores, 
had  higher  school  marks  than  did  the  boys. 

To  the  writer,  it  seems  that  facts  like  these  should  help  high- 
school  principals  in  their  problems  of  prognosis  and  guidance. 
The  group  intelligence  test  does  not,  of  course,  displace  other 
means  of  doing  this.  However,  it  provides  a  quick  and  service- 
able way  of  getting  at  one  of  the  most  important  factors  in  the 
success  of  a  student  in  his  school  work,  namely,  his  intelligence. 


AN  EXPERIMENT  IN  ARRANGING  HIGH-SCHOOL  SEC- 
TIONS ON  THE  BASIS  OF  GENERAL  ABILITY 

Ernest  P.  Branson 

Supervisor,  Department  of  Research,  Long  Beach  City  Schools,  Long  Beach, 

California 

In  October  and  November,  1919,  some  nine  hundred  pupils 
in  the  eighth  grades  of  the  Long  Beach,  Cahfornia  schools  were 
tested  with  the  Otis  Group  Intelligence  Scale.  Since  half  of  these 
pupils  were  to  enter  high  school  the  following  February,  it  was  de- 
cided to  select  in  advance  two  classes  in  high-school  English  partly 
on  the  basis  of  the  test  scores.  These  two  high-school  sections 
will  be  known  as  Sections  A  and  D.  Section  A  was  composed  of 
those  younger  pupils  whose  Otis  scores  were  high.  Section  D  was 
composed  of  those  older  pupils  whose  Otis  scores  were  low.  The 
average  age  in  Section  A  was  13.6  years;  in  Section  D,  14.7  years. 
The  average  score  in  Section  A  was  143.5;  in  Section  D,  93.5. 

Both  sections  were  given  to  the  same  teacher  without  any  hint 
as  to  difference  in  ability.  In  less  than  a  week  the  teacher  had 
noticed  it  and  had  reported  it  to  the  head  of  the  department  and 
to  the  vocational  adviser.  Since  we  had  previously  agreed  to  wait 
until  the  teacher  showed  that  she  was  aware  of  the  difference  be- 
fore revealing  that  an  experiment  was  in  progress;  it  was  now  time 
to  take  the  teacher  into  our  confidence.  At  the  end  of  the  second 
week  in  the  high  school  each  of  the  two  groups  was  tested  with  the 
Holley  Sentence  Vocabulary  Scale,  Series  3B.  The  teacher  was 
told  to  proceed  with  the  work  of  the  term,  adapting  it  to  the 
capacity  of  each  section  according  to  her  judgment. 

At  the  end  of  the  term  the  same  test  was  given  aga"n  without 
announcement  in  advance.  The  test  is  one  of  general  language 
ability  and  correlates  well  with  general  intelligence.  It  consists 
of  the  words  embodied  in  incomplete  sentences,  which  are  to  be 
filled  out  by  the  choice  of  one  of  four  suggested  words. 

In  the  teacher's  opinion  the  groups  were  better  social  groups 
because  of  the  similarity  of  ability.  Instruction  was  easier  than 
it  would  have  been  if  the  groups  had  been  mixed.  Indeed  the 
only  difficulty  in  instruction  lay  with  the  poorer  class;  and  this 
was  largely  because  the  teacher  lacked  definite  knowledge  as  to 
how  much  she  could  change  the  course  of  study  and  yet  make  it 
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possible  for  these  pupils  to  take  regular  work-in  later  terms.  The 
effect  on  individuals  was  good,  some  in  the  better  section  making 
their  first  apparent  effort.  The  teacher  could  judge  on  this  point 
as  she  had  previously  been  the  departmental  English  teacher  of  a 
number  of  them.  The  brighter  ones  when  matched  with  their 
equals  apparently  found  effort  worth  while.  It  may  be  pointed 
out  here  that  the  usual  class  contains  enough  average  and  dull 
pupils  to  quench  the  fire  of  some  who  possess  unusual  ability. 

In  Section  D,  fourteen  pupils  were  present  throughout  the 
experiment.  All  of  these  had  been  assigned  in  accordance  with 
the  teacher's  judgment.  In  Section  A,  twenty-two  pupils  were 
present  for  the  entire  period.  The  teacher  felt  that  three  of  them 
had  not  been  satisfactorily  assigned.  One  was  a  somewhat 
retarded  pupil;  the  other  two  were  suspected  of  being  tem- 
peramentally unfitted  for  successful  school  work.  The  test  re- 
sults confirm  the  suspicion.  Each  section  contained  other  misfit 
pupils  who  were  assigned  to  these  sections  by  the  exigency  of 
crowded  rooms,  not  as  part  of  the  experiment. 

The  assignments  on  the  basis  of  test  results  were  more  satis- 
factory in  the  case  of  the  poorer  section,  despite  the  fact  that  a 
poor  score  may  be  due  to  an  accidental  factor  such  as  illness  or 
fatigue.  The  assignments  to  the  better  section  were  not  quite 
as  satisfactory  to  the  teacher,  though  the  high  scores  of  pupils  in 
this  section  could  hardly  be  due  to  an  accidental  factor. 

But  why  did  these  pupils  of  apparently  superior  ability  fail 
to  take  hold  of  the  work  as  well  as  the  rest  of  the  section?  This 
question  is  related  to  one  that  appears  when  the  results  of  the  first 
and  second  vocabulary  tests  are  compared.  The  losses  in  the 
scores  of  individuals  are  most  noticeable  in  the  case  of  those  who 
made  very  high  scores  the  first  time.  It  seems  that  the  superior 
pupils  were  less  dependable  in  school  routine.  The  first  test  was 
a  novelty;  and  they  did  their  best.  The  second  time  a  little  less 
effort  lowered  the  scores  a  bit.  The  Pearson  coefficients  of  cor- 
relation confirm  this  view.  The  correlation  between  the  first  and 
second  tests  was  0.85  for  Section  D  and  0.67  for  Section  A. 

While  rating  presented  no  problem  in  Section  A,  in  Section  D 
grades  were  given  as  follows:  1  student  received  A;  3  students 
received  C;  10  students  received  C — ;  5  students  received  D. 
"C — "  means  credit  granted  on  condition.    The  condition  for  these 
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RESULTS  AS  SHOWN  BY  THE  HOLLEY  SENTENCE 
VOCABULARY  SCALE 

Medians 
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First 
Test 
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First 
Test 
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A 

48 
63 

49.5 
66.5 

33 
47 

38 
55 

66 
79 

64 
79 

0.85 
0.67 

0.30 
0.41 

pupils  was  that  they  enroll  in  a  designated  section  for  the  next 
semester,  Section  D  being  held  together  in  this  way.  This  solu- 
tion of  the  granting  of  credit  for  the  necessarily  inferior  work  done 
and  this  method  of  holding  the  class  together  is  not  wholly  satis- 
factory, but  it  is  the  best  upon  which  the  teacher,  head  of  the  de- 
partment, vocational  adviser,  and  registrar  found  themselves  in 
agreement.  The  principal  of  the  high  school  humanely  insists 
that  it  is  wrong  to  put  the  C — stigma  on  the  efforts  of  these  pupils. 
They  should  be  saved  that  sense  of  failure. 

Any  estimate  of  the  results  of  this  experiment  is  a  happy  one 
compared  with  what  must  have  happened  to  these  pupils  if  scat- 
tered throughout  the  school.  All  the  weaker  pupils  must  surely 
have  failed;  discouragement  would  have  caused  them  to  leave 
school  in  most  cases,  for  that  is  the  history  of  poor  ability — quick 
elimination  from  opportunity.  As  for  Section  A,  the  intellectual 
leadership  of  the  next  generation  depends  on  giving  the  widest 
opportunity  for  development  to  those  best  fitted  to  lead. 

Two  thoughts  occur  to  us  as  a  result  of  our  experience  with 
these  classes.  First,  the  course  of  study  should  be  examined  with 
the  needs  of  weak  classes  in  mind.  Definite  modifications  in 
subject  matter  and  method  should  be  made  in  order  to  fit  a  course 
of  study  to  the  needs  and  capacities  of  this  group.  Second,  the 
granting  of  credits  and  the  system  of  credit  bookkeeping  and  pro- 
gram planning  should  be  made  as  elastic  as  possible  in  order  to 
aid  these  pupils  to  remain  in  school  without  the  sense  of  failure. 
To  do  one's  best  is  not  failure. 


THINGS  WE  DO  NOT  KNOW 

Nothing  is  better  calculated  to  engender  humility  of  spirit  than 
conducting  a  reference  department  in  an  educational  office.  The 
Bureau  of  Educational  Research  of  the  University  of  Illinois  has 
been  offering  this  service;  and  the  school  people  have  proposed 
all  sorts  of  questions,  problems,  and  perplexities.  Indeed,  if  we 
could  give  a  corporate  existence  to  the  school  people,  we  should 
say  that  they  differ  from  the  small  boy  when  he  cuts  loose  on  his 
bewildered  father  only  by  being  "more  so."  For  example,  Mary 
Smith — this  is  no  nom  de  plume — wrote,  "Will  you  please  tell  me 
how  to  make  the  teaching  of  Caesar  more  interesting?"  At  this 
juncture  we  were  inclined  to  resign.  So  far  as  we  are  aware,  the 
teaching  of  Caesar  is  not  only  uninteresting  but  intentionally, 
avowedly,  and  blatantly  so.  Its  uninteresting  character  is  indeed 
its  alleged  virtue.  Nevertheless,  we  took  the  request  quite  seri- 
ously and  so  gladdened  Mary's  heart  that  her  colleague,  Alice,  in 
the  history  department  promptly  wrote  for  "any  information  in 
regard  to  supplementary  material  for  a  high-school  course  in 
ancient  history."  Six  months  later  Alice  again  appeared  on  the 
scene,  this  time  as  a  geometry  teacher,  but  with  the  same  childlike 
faith  in  our  omniscience. 

Not  exactly  easy  is  the  topic  sent  us  by  a  committeeman  who  in 
a  moment  of  weakness  had  evidently  agreed  to  report  to  some 
organization  on  "Curriculum  Reconstruction  Due  to  the  War." 
He  passed  the  task  on  to  us  without  subdivision  or  modification. 
Now,  the  curriculum  without  reference  either  to  war  or  to  recon- 
struction is  sufficiently  baffling.  But  as  a  problem  f-or  realignment 
because  of  the  conditions  and  results  of  the  world  conflict,  it 
becomes  a  quagmire  crossed  here  and  there  by  prints  of  human 
feet  but  devoid  of  paths  which  lead  anywhere  in  particular. 

But  perhaps  we  were  never  more  completely  overestimated 
than  when  we  received  from  the  president  of  a  woman's  club  a 
request  for  material  on  "The  World:  Its  Problems  and  Its  Prog- 
ress"— all  on  a  postal  card.  Considering  the  fact  that  this  in- 
teresting proposal  arrived  when  the  world  was  decidedly  wabbly 
and  its  progress  altogether  problematical,  our  correspondent  has 
probably  forgiven  us  for  withholding  complete  information  on  her 
timely  topic. 
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But  not  all  the  topics,  nor  indeed  very  many  of  them,  have 
such  an  impossible  scope.  Some  others,  however,  although  they 
may  be  more  precise  and  have  greater  dignity  as  practical  ques- 
tions, are  nevertheless  elusive.  Not  a  few  of  them  would  make 
admirable  topics  for  dissertations.  For  example,  one  writes, 
"We  are  to  build  a  new  community  high-school  building.  We 
shall  have  $100,000  to  spend  and  shall  need  to  provide  for  two 
hundred  students  in  the  future.  We  want  plans  of  new  buildings, 
lists  of  equipment,  etc.  We  expect  to  provide  courses  in  academic 
subjects,  agriculture,  domestic  science,  manual  training,  the 
sciences  (biological,  physical,  and  chemical),  and  commercial 
subjects.  We  also  ought  to  have  a  gymnasium  and  if  possible 
a  swimming  pool."  The  writer  adds  with  sudden  realization  of  the 
high  cost  of  building,  "We  are  probably  too  ambitious  for  our 
purse."  Nevertheless,  he  has  a  definite  problem;  and  he  has  done 
some  thinking  for  himself.  He  states  the  conditions  with  clearness 
and  vigor. 

Again,  a  school  board  member,  who  is  also  a  physician,  writes: 
"Can  you  send  me  something  in  print  which  deals  with  the  general 
subject  of  daylight  illumination,  particularly  the  questions  of  the 
proper  amount  (ideal,  maximum,  and  minimum)  of  light  to  reach 
the  child's  school  book,  character,  quality,  and  direction  of  source 
considered,  also  some  information  as  to  the  amount  of  light  reach- 
ing northern  Illinois  from  the  sky,  direct  sun  rays  not  considered, 
both  in  clear  and  cloudy  weather  through  the  winter  season?" 
This  again  is  a  topic  of  specific,  practical  character.  It  is  also  a 
topic  concerning  which  we  have  little  satisfactory  information. 
Such  a  topic  might  engage  the  earnest  and  prolonged  attention  of 
students  of  physics  and  meteorology  as  well  as  of  education. 

The  topics  we  have  mentioned  are  incapable  of  being  answered 
in  the  present  state  of  our  knowledge.  Whether  they  are  thought- 
fully or  uncritically  expressed,  they  rest  upon  assumptions  as  to  the 
availability  of  data  which  are  not  justified.  Ways  of  making  the 
teaching  of  Caesar  more  interesting  are  not  matters  of  record. 
Successful  teachers  seldom  leave  behind  them  any  footprints  in 
the  sands  of  pedagogy.  Curriculum  reconstruction  can  only  be 
undertaken  with  great  labor  by  many  people  working  on  a  common 
problem  from  various  points  of  view.  Specifications  for  buildings 
and  precise  data  on  illumination  have  not  been  gathered  in  suflB.- 
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ciently  authentic  detail  to  be  helpful.  We  do  not  assert  that  these 
questions  are  either  frivolous  or  impossible.  The  answers  to  them, 
however,  are  not  at  present  in  existence.  They  involve  for  their 
solution  long  and  painstaking  investigation  and  the  cooperation  of 
students  in  several  fields  of  knowledge. 

But  other  questions  are  received  which  are  definite,  practical, 
and  obviously  worth  while.  Yet  in  many  cases  answers  to  these 
questions  are  likewise  unobtainable.  For  example,  "Do  you 
know  of  any  standard  of  expenditures  for  school  purposes,  that  is, 
whether  or  not  anyone  has  estimated  or  determined  what  percent 
ought  to  be  expended  by  school  authorities  for  the  various  items 
under  the  topics  of  general  control,  instruction,  operating  plant, 
maintenance,  ...  in  the  present  system  of  accounting  used  by 
federal  and  state  departments?"  To  obtain  such  facts  for  school 
systems  of  different  sizes  would  require  nothing  more  than  the 
clerical  service  necessary  to  combine  figures  obtained  from  systems 
using  the  approved  classification  of  accounts.  Not  only  superin- 
tendents and  boards  of  education  but  also  the  general  public  would 
be  interested  in  knowing  what  they  might  be  expected  to  expend 
for  libraries,  promotion  of  health,  teachers'  salaries,  etc.  in  order 
to  be  up  to  the  standard  in  such  matters. 

Another  correspondent  asks,  "What  is  the  standard  rate  of 
attendance?"  This  is  apparently  a  simple  question.  All  we  need 
to  do  is  to  consult  the  reports  of  superintendents  for  the  attend- 
ance rates  in  different  locaUties,  and  by  summarizing  these  we 
may  arrive  at  a  notion  of  the  usual  rate.  As  a  matter  of  fact, 
however,  there  is  no  good  answer  to  this  question.  It  is  one  of  the 
things  we  ought  to  know  but  do  not. 

Again,  a  superintendent  wants  to  know  the  typical  amount  of 
retardation  in  cities  of  100,000  or  more.  Another,  thinking  along 
the  same  line,  wants  to  know  the  ages  of  eighth-grade  graduates 
and  of  high-school  graduates.  Still  another  writes  to  ask  what 
has  been  done  to  determine  "what  might  be  termed  'the  legitimate 
percent  of  failures'  among  high-school  pupils." 

Perhaps  we  have  said  enough  to  indicate  why  we  are  humble. 
Although  not  all  the  questions  we  receive  are  worthy,  far  the 
greater  part  of  them  represent  a  real  need  on  the  part  of  somebody. 
Moreover,  many  of  them  are  relatively  simple;  yet  a  surprisingly 
large  number   caimot  be   answered  convincingly.     Among  the 
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subjects  of  masters'  and  doctors'  theses,  of  educational  mono- 
graphs and  articles,  we  do  not  find  enough  of  the  problems  which 
are  really  confronting  teachers,  supervisors,  and  administrators. 
It  would  be  infinitely  to  the  advantage  of  educational  inquiry  if 
topics  for  research  showed  a  closer  relationship  to  the  actual  needs 
of  the  school.  The  fact  that  they  do  not — the  fact  that  those  who 
know  the  concrete  problems  are  not  doing  the  educational  writing 
while  too  often  those  who  write  do  not  appreciate  the  problems — 
accounts  for  the  astonishingly  large  number  of  things  we  do  not 
know. 

B.  R.  B. 

EDUCATIONAL  RESEARCH  BY  MEMBERS  OF  THE  AMERICAN 
PSYCHOLOGICAL  ASSOCIATION 

In  the  August  (1920)  number  of  the  Psychological  Bulletin  Dr. 
Boring,  secretary  of  the  American  Psychological  Association, 
summarizes  statistics  on  the  research  fields  in  which  393  members 
of  the  association  report  themselves  to  be  working.  The  statistics 
include  all  the  members  of  the  association  except  a  few  who  failed 
to  report  on  this  item.  A  member  who  reported  two  or  more 
fields  was  accredited  fractionally  to  each  of  ..he  fields,  which 
accounts  for  the  fractions  in  the  figures  given  below.  Of  the  393 
reporting,  53  are  carrying  on  no  research.  The  remaining  340  are 
classified  as  follows  in  Table  VI  of  Dr.  Boring's  article: 


II. 


Field  of  Research 

Number  Accr 

Non-psychological  Fields 

1.  Philosophy 

15.7 

2.  Aesthetics 

1.7 

3.  Anthropology 

2.6 

Total  20.0 

Chiefly  Pure  Psychology 

4.  General  psychology 

8.7 

5.  Experimental  psychology 

81.6 

6.  Theoretical  psychology 

37.4 

7.  Animal  psychology 

15.5 

8.  Psychology  and  neurology 

4.2 

or  5.9% 


Total  147.4  or  43.4% 
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III.  Social  and  Industrial  Psychology 

9.  Social  psychology  6.1 

10.  "Applied"  psychology  10.7 

1 1 .  Industrial  psychology  7 . 4 


Total  24.2  or  7.1% 


IV.    Chiefly  Education 

12.  Tests  54.2 

13.  Educational  psychology  43.9 

14.  Education    (including    experimental 
pedagogy)  13.2 

15.  Clinical  psychology  13.7 

16.  Statistical  method  1.2 


V. 


Total  126. 2  or  37.1% 

17.  Abnormal  psychology 

18.  Psychiatry 

19.  Psychopathology 

7.2 
2.5 
7.0 

Miscellaneous 

Total  16.7  or  4.9% 
5 . 0  or  1 . 5% 

Grand  Total     339 . 5  or  99 . 9% 

Although  a  classification  like  that  attempted  by  Dr.  Boring 
cannot  be  free  from  certain  ambiguities,  two  important  facts  are 
tentatively  established  by  his  data: 

1.  When  we  combine  the  figures  for  the  three  fields  of  applied 
psychology  (education,  psychopathology,  and  social  and  industrial 
psychology)  it  is  seen  that  this  group  accounts  for  167.1  of  the 
340,  which  is  49 . 1  percent  of  the  total  number. 

2.  Approximately  37  percent  of  the  340  members  of  the 
American  Psychological  Association  who  are  doing  research  work 
are  accredited  to  the  field  of  education.  Surely  the  future  of  the 
Journal  of  Educational  Research  ought  to  be  assured. 

L.  M.  T. 
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A  BOOK  OF  CASES 

In  their  educational  reading  teachers  are  looking  for  things 
they  can  use.  No  doubt  they  often  give  too  narrow  an  interpreta- 
tion to  the  term  useful,  and  we  observe  that,  actuated  by  this 
impulse,  they  are  subscribing  in  enormous  numbers  for  periodicals 
devoted  to  devices  most  of  which  are  shallow  and  inconsequential. 
Nevertheless  this  demand  for  things  that  will  work  has  its  meaning 
for  investigators.  It  raises  the  question  of  a  worthy  substitute 
for  the  mere  device. 

To  be  more  specific,  we  note  that  in  connection  with  testing 
programs  there  has  been  some  disappointment  because  the  super- 
intendent or  the  research  director  has  so  frequently  failed  to  follow 
up  the  testing  with  a  campaign  of  betterment.  This  has  meant 
that  many  of  the  lessons  of  the  testing  have  been  lost.  High 
hopes,  entertained  when  the  testing  was  begun,  have  not  always 
been  realized.  In  casting  about  for  something  concrete  and  vital 
to  say  to  teachers  on  the  procedure  to  be  followed  as  a  result  of 
testing,  we  have  become  convinced  that  the  form  of  reporting  may 
be  improved. 

We  commonly  present  our  material  in  tables;  and  these  tables 
constitute  the  framework  of  our  discussion.  Yet  individual  cases 
are  entirely  lost  in  tabular  statements,  unless  the  tables  are  very 
detailed — and  in  that  case  they  are  usually  too  long  to  print.  A 
table  of  the  usual  type  may  indicate,  for  example,  the  number  of 
ten-year-old  children  belonging  to  the  fifth  grade  and  having  scores 
of  7  in  addition,  40  in  handwriting,  etc.  Such  a  table,  however, 
does  not  permit  us  to  express  the  characteristics  and  achievements 
of  separate  individuals.  We  cannot  be  sure  that  a  single  child 
actually  exemplified  in  himself  the  conditions  we  have  mentioned. 
A  table,  to  the  extent  that  it  is  a  summary — and  almost  all  printed 
tables  are  summaries — offers  little  upon  which  detailed  practice 
can  be  based.  Neither  do  the  articles  which  are  written  around 
such  tables.    They  are  of  general  but  rarely  of  specific  application. 

We,  therefore,  suggest  as  an  especially  useful  type  of  material 
for  the  guidance  of  teachers  the  detailed  reporting  of  cases.  A 
"case"  is  a  child  with  his  recorded  characteristics,  antecedents, 
and  achievements — a  child  who  is  attending  school  and  who  neces- 
sarily presents  at  various  points  in  his  school  career  problems 
which  are  met  by  some  sort  of  procedure.    The  report  of  a  case  is 
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merely  a  descriptive  and  narrative  biography  of  the  child  in 
question  as  he  proceeds  through  school.  It  has  something  to  say 
about  his  family  and  his  personal  traits,  but  more  especially  it  is 
devoted  to  a  chronicle  of  what  was  done  by  him  and  the  teacher  (or 
other  official)  and  of  what  resulted  from  the  action  taken. 

Our  effort  to  secure  practical  data  has  forced  us  to  the  conclu- 
sion that  far  more  useful  than  cheap  devices  and  quite  as  dignified 
as  most  of  our  research  would  be  a  collection  of  reports  of  such 
cases,  properly  classified  and  indexed.  In  the  practice  of  law  this 
is  precisely  what  is  done.  Good  law  is  simply  a  case  which  applies 
to  the  matter  in  hand.  Wigmore  on  evidence  or  Williston  on  con- 
tracts or  any  one  of  the  various  encyclopedias  of  law  are  essentially 
citations  of  cases,  classified  and  indexed  so  that  they  can  be 
applied  to  aid  in  the  determination  of  almost  any  question. 

The  analogy  between  school  cases,  and  court  cases  cannot,  of 
course,  be  pressed  too  far.  The  legal  case  is  more  than  a  state- 
ment of  conditions  as  revealed  by  the  evidence.  It  also  involves 
a  decision  by  an  authority  of  competent  jurisdiction.  Indeed  the 
whole  body  of  legal  doctrine  is  based  upon  decisions  rendered  in 
actions  before  courts  constituted  for  the  express  purpose  of  making 
decisions.  The  essence  of  the  legal  case,  therefore,  resides  in  the 
fact  that  something  is  decided.  The  school  case,  however,  does  not 
appear  in  an  institution  whose  chief  purpose  is  to  render  decisions. 
The  school  does  other  things,  and  when  it  makes  a  ruling,  its  ruling 
is  by  no  means  above  dispute.  Yet  even  in  school  the  means  are 
becoming  available  for  reaching  decisions — not  merely  decisions 
by  constituted  authority  but  decisions  based  upon  impersonal 
standards  whose  applicability  cannot  easily  be  questioned.  It  is 
clear,  therefore,  that  given  the  machinery  for  transmitting 
accounts  of  the  cases  and  of  the  decisions  rendered  in  them,  a  body 
of  educational  doctrine  may  be  built  up  for  the  guidance  of  practi- 
tioners. 

If,  for  example,  we  had  as  a  beginning  a  thousand  well-estab- 
lished and  typical  case  reports,  in  each  of  which  the  salient  facts 
about  a  child  were  given  with  the  different  crises  that  arose  in  his 
school  career  and  the  measures  that  were  taken  to  meet  them,  we 
should  no  doubt  have  a  body  of  material  which  in  richness  and  in 
utility  for  schoolroom  practice  would  quite  exceed  that  of  any 
book  which  has  ever  been  published.  This  ''Book  of  a  Thousand 
Cases"  would  be  a  vade  mecum  for  every  teacher.    In  it  would  be 
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found  the  means  by  which  resourceful  teachers  have  coped  with 
the  difficulties  of  their  craft.  For  there  are  really  few  if  any  new 
problems  in  teaching.  There  are  new  phases  of  old  problems,  but 
it  is  scarcely  thinkable  that  at  this  late  day  any  really  new  crux 
ever  appears  in  a  schoolroom.  The  overgrown  and  backward 
child,  the  child  who  is  shy,  the  child  who  has  a  special  disability  in 
mathematics,  the  sullen  and  the  sunny,  the  honest  and  the  dis- 
honest, the  leader  and  the  follower — all  these  have  been  attending 
school  time  out  of  mind.  They  have  been  coaxed  or  cudgled, 
stimulated  or  repressed,  punished  or  rewarded.  The  point,  how- 
ever, is  that  the  inexperienced  teacher  must  meet  all  these  condi- 
tions as  if  they  had  never  existed  before.  To  her  the  experience  of 
her  predecessors  is  nothing.  She  must  tread  the  same  path  that 
others  have  trod,  meet  the  same  difficulties  that  others  have  met, 
fail  or  succeed  for  the  same  reasons  that  have  influenced  thousands 
of  others.  She  has  no  guidance  from  them,  no  friendly  lessons  of 
caution  from  their  mistakes,  no  inspiration  from  their  successes. 

Of  course,  one  reason  why  there  is  little  available  concrete 
material  of  the  sort  which  we  have  in  mind  is  because  the  school, 
unlike  the  courts,  have  no  systematic  means  of  record-making. 
Most  of  our  actions  leave  no  deposit;  and  if  any  record  is  made  of 
them,  it  is  only  for  temporary  use.  As  soon  as  it  has  served  its 
immediate  purpose,  it  is  discarded  and  lost.  For  example,  most 
teachers  appear  never  to  realize  that  they  themselves — to  say 
nothing  of  others — could  make  good  use  next  year  of  the  examina- 
tion questions  they  make  out  this  year.  Very  few  teachers  of  our 
acquaintance  have  been  able  to  give  any  intelligent  estimate  of  the 
abilities  of  children  one  year  as  compared  with  another  because 
their  methods  of  testing  pupils  have  passed  out  of  their  minds  and 
have  been  unrecorded  from  year  to  year. 

The  case  book  of  which  we  are  speaking,  the  book  which  will 
will  bring  concrete  situations  before  the  teachers  who  can  profit 
by  them,  will  rest  for  its  publication  upon  systematic  record- 
making  in  the  classroom  and  school  office — record-making  which 
is  a  little  burdensome,  a  little  tedious,  and  altogether  uninspiring. 
We  venture  to  believe,  however,  that  if  this  record-making  could 
be  developed  even  in  a  few  centers,  and  if  the  first  case  book,  edited, 
interpreted,  classified,  indexed,  and  cross-referenced,  could  once' 
appear,  it  would  justify  by  its  usefulness  every  effort  through 
which  it  was  produced.  B.  R.  B. 


squirms  nnh  Abatrarta 

E.  H.  Cameron,  Editor 


Arithmetic:  report  of  progress.    Duluth  Public  Schools,  1919. 

The  above  report  represents  the  course  of  study  in  arithmetic  in  the  public  schools 
in  the  city  of  Duluth.  It  was  introduced  in  September  1919,  having  been  constructed 
during  the  previous  school  year  through  the  combined  effort  of  teachers,  principals 
and  supervisors  in  the  public  schools  and  of  representatives  of  the  State  Normal  School 
of  Duluth.  While  the  principals,  supervisors,  and  representatives  from  the  normal 
schools  were  responsible  for  formulating  the  general  principles  underlying  the  course 
of  study,  much  of  the  actual  selection  of  the  subject  matter  to  be  taught  and  its 
arrangement  in  the  course  of  study  represents  the  work  of  the  teachers  themselves. 
In  fact,  the  contribution  which  the  teachers  have  evidently  made  is  one  of  the  distinc- 
tive features  of  the  report. 

The  report  begins  with  a  concise  statement  of  the  aims  to  be  accomplished  and  the 
attitudes  to  be  developed  through  the  teaching  of  arithmetic — statements  reflecting 
the  social  values  in  education.  The  brief  outline  of  the  subject  matter  composing  the 
next  portion  of  the  report  is  the  direct  outcome  of  emphasizing  the  following  aims : 
(1)  to  enable  one  to  do  the  ordinary  computing  required  in  common  business;  (2)  to 
give  arithmetical  knowledge  that  fits  into  the  real  situations  of  home,  shop,  farm  or 
business;  (3)  to  acquaint  pupils  with  the  simplest  methods  used  in  business.  At  all 
times  the  subject  matter  has  been  chosen  upon  the  basis  of  the  social  and  individual 
needs  of  the  child. 

After  a  brief  survey  of  the  subject  matter  of  the  course,  comes  another  distinctive 
feature  of  the  report — one  usually  lacking  in  courses  of  study — namely,  a  statement  of 
general  directions  for  classroom  procedure  and  a  discussion  of  the  underlying  principles 
in  such  procedure.  This  section  of  the  report  is  very  specific  and  suggests  to  the 
teacher  just  what  to  do  in  minute  detail.  These  directions  and  principles  contain 
almost  all  the  scientifically  established  facts.  Indeed,  the  section  includes  a  quotation 
from  "Principles  of  Method  in  Teaching  Arithmetic  as  Derived  from  Scientific  Investi- 
gation" in  the  Eighteenth  Yearbook  of  the  National  Society  for  the  Study  of  Education. 
The  section  closes  with  a  brief  discussion  of  the  various  standardized  tests  in  arithmetic, 
giving  a  description  of  the  tests  and  the  standards  of  achievement. 

The  next  section  of  the  report  is  a  detailed  statement  of  the  work  of  each  grade, 
with  special  emphasis  on  the  following  heads:  directions,  subject  matter  and  projects, 
optional  work,  standards  of  attamment  and  bibliography.  Three  thmgs  deserve  spe- 
cial mention  in  this  section.  (1)  The  explicit  directions  suggesting  to  the  teacher  the 
proper  method  for  dealing  with  the  commonly  overlooked  things  in  teaching;  (2)  the 
elaborate  description  of  a  major  project  and  a  suggested  list  of  minor  projects.  This 
portion  of  the  report  is  in  keeping  with  best  educational  thought  and  should'  be  wel- 
comed by  all  teachers  interested  in  project  teaching;  (3)  the  detailed  bibliography 
referring  the  teachers  to  the  exact  chapters  which  deal  with  the  problems  peculiar  to 
the  particular  grade.  ■  The  report  closes  with  a  well-selected  bibliography  on  various 
aspects  of  the  teaching  of  arithmetic. 
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In  general  this  report  represents  the  embodiment  of  our  best  modern  theories  of 
education  and  the  inculcation  of  the  best  scientifically  established  principles.  It  is 
more  than  a  course  of  study.  It  is  an  outline  of  methods  as  well — such  a  combination 
being  made  possible  through  the  cooperation  of  specialists,  administrators,  and  teach- 
ers.   Other  cities  could  well  follow  the  example  of  Duluth.  C.  W. 

Arithmetic  survey  in  the  public  schools  of  Newark,  N.  J.    Newark,  New  Jersey:  Board 
of  Education,  December  1919. 

This  report  presents  the  results  of  a  survey  of  arithmetic  in  the  Newark  public 
schools,  conducted  in  1919  under  the  direction  of  Mr.  Elmer  K.  Sexton,  assistant  super- 
intendent in  charge  of  the  Department  of  Reference  and  Research.  In  this  survey, 
the  Woody  Scales,  Series  B,  and  the  Stone  Reasoning  Test  were  given.  The  giving  of 
these  tests  and  the  scoring  of  the  results  deviate  somewhat  from  the  usual  practice 
followed  in  surveys  in  that  a  teacher  was  sent  to  each  school  (in  no  case  the  school 
where  she  regularly  taught)  to  give  all  the  tests  in  that  school  and  in  that  the  test  papers 
were  scored  by  the  staff  of  the  Department  of  Reference  and  Research. 

The  reports  set  forth  comparisons  of  results  attained  in  Newark  with  those 
attained  in  other  cities,  comparisons  of  the  achievements  in  various  schools  in  Newark, 
comparisons  of  achievements  of  specialized  groups  of  children,  e.g.,  Italian  and  Hebrew 
children,  children  from  prosperous  American  parents  and  those  from  less  prosperous 
American  parents,  etc.    The  later  sections  of  the  report  deal  with  the  analysis  of  errors. 

The  most  significant  conclusions  are : 

1.  The  children  of  Newark  surpass  the  Woody  standards  in  all  grades  below  va 
and  fail  to  attain  the  standards  in  the  higher  grades.  In  this  connection  it  should  be 
said  that  recent  investigations  indicate  that  the  original  Woody  standards  upon 
which  these  comparisons  are  made  are  low  in  the  lower  grades. 

2.  The  children  of  Newark  make  a  high  record  in  the  Stone  test,  but  not  as  high  as 
the  children  of  Salt  Lake  City. 

3.  That  there  is  a  high  correlation  between  the  scores  attained  in  the  funda- 
mentals and  in  the  reasoning  problems.  This  correlation  was  not  calculated  and 
seems  to  be  based  upon  class  scores  rather  than  upon  scores  of  the  individual  pupils. 

4.  The  Hebrew  children  surpass  all  others  in  the  fundamentals  but  are  excelled 
by  the  Americans  in  reasoning. 

5.  There  is  no  significant  difference  between  the  results  achieved  by  the  children 
from  the  more  prosperous  and  the  less  prosperous  homes. 

The  report  is  very  carefully  worked  out  and  should  be  very  helpful  to  teachers 
and  supervisors.  It  should  be  welcomed  by  those  who  have  had  little  experience  in 
testing  for  it  represents  the  proper  method  of  dealing  with  test  results  to  make  the 
measurements  most  worth  while.  It  appears  that  the  report  would  be  more  easily 
interpreted  if  there  had  been  a  greater  utilization  of  graphic  presentation. 

C.  W. 

Bartholomew,  W.  E.  and  Hurlburt,  Floyd.     The  business  man's  English.    New 
York:  Macmillan  Company,  1920.    340  pp. 

This  book  forms  an  excellent  introduction  to  the  very  many  problems  that  arise 
in  the  use  of  English  in  business.  It  is  in  fact  a  course  in  business  letter  writing  with 
several  introductory  chapters  on  matters  of  correct  and  effective  English  and  with 
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some  supplementary  chapters  on  office  practice,  report  writing,  proof  reading,  and  the 
like.  The  subject  matter  is  authoritative  and  up-to-date,  a  first  essential  when  one  is 
deaUng  with  such  a  changing  thing  as  business  practice.  A  great  wealth  of  material 
is  presented  with  striking  conciseness,  and  yet  with  such  an  abundance  of  exercises 
that  the  classroom  teacher  will  find  the  book  a  practical  text.  Every  effort  has  appar- 
ently been  made  to  make  the  sections  on  errors  and  correctness  of  English  just  as 
practical  as  possible,  and  in  this  respect  the  book  is  clearly  superior  to  some  recent  texts 
on  "applied"  English.  Such  a  book  as  this  in  high  school  furnishes  a  practical  outlook 
that  is  the  best  and  most  powerful  incentive  for  composition  work,  and  it  will  be 
welcomed  by  teachers  who  are  eager  for  better  results  in  this  direction.  Of  course, 
in  any  book  which  tries  to  cover  an  immense  field,  there  is  an  inevitable  loss  of  empha- 
sis on  what  many  would  feel  to  be  the  more  essential  matters.  This  defect,  however, 
any  teacher  can  easily  remedy  simply  by  passing  over  certain  parts  and  putting  more 
time  on  others. 
University  of  Illinois  E.  W.  Dolch 

Hill,  David  Spence.    Introduction  to  vocational  education.    New  York:  Macmillan 

Company,  1920.    475  pp. 

In  this  volume  Dr.  Hill  has  done  what  needed  very  much  to  be  done.  He  has 
brought  together  widely  varying  data  and  materials  from  widely  diverse  fields  and 
has  organized  them  into  a  study  of  vocational  education. 

A  glance  at  the  table  of  contents  reveals  an  unusual  breadth  of  treatment  running 
all  the  way  from  "Safeguarding  American  Democracy"  in  chapter  i,  and  "Adjustments 
to  Individual  and  Society"  in  chapter  in,  through  "Education  for  Mechanical  Trades 
and  Industries"  in  chapters  vin  and  rx,  to  "Applications  of  Psychology  to  Instruc- 
tion and  Industry"  in  the  thirteenth  and  last  chapter. 

The  author  has  very  wisely  incorporated  the  Smith-Hughes  Act  and  the  Smith- 
Sears  Act  in  their  entirety  in  the  Appendix. 

Following  each  chapter  is  a  very  complete  list  of  references  selected  with 
discrimination  and  with  full  appreciation  of  the  needs  of  that  particular  chapter. 

The  book  will  make  its  chief  contribution  as  a  reference  for  libraries,  as  a  help  to 
students  of  education,  and  as  a  source  of  information  to  the  lay  reader  who  is  inter- 
ested in  the  newer  phases  of  the  modern  school. 
University  of  Illinois  S.  J.  Vaughn 

Mackle,  Ransom  A.    Education  during  adolescence.    New  York:  E.  P.  Dutton  and 

Company,  1920.    189  pp. 

This  volume,  as  the  author  freely  acknowledges,  is  based  upon  the  work  of  G. 
Stanley  Hall.  Some  seventy  different  citations  to  Dr.  Hall's  writings  are  made  in 
support  of  the  theses  presented.  A  plea  is  made  for  the  junior  high  school,  the  elective 
principle  in  secondary  education  with  a  definite  leaning  toward  vocationalism,  a  cer- 
tain irreducible  number  of  constants — English,  social  studies,  history — and  a  new 
procedure  along  the  lines  of  the  socialized  recitation.  The  book  contains  copious 
quotations  from  exponents  of  the  principles  of  self-activity  as  opposed  to  a  lifeless 
formalism  and  uniformity  in  educational  practice.  Typical  curricula  for  the  junior 
and  senior  high  schools  are  discussed. 

The  author,  being  an  ardent  disciple  of  Dr.  Hall,  accepts  without  question  and  with 
enthusiasm  the  theory  of  saltatory  development.    Upon  this  hypothesis  is  worked  out 
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an  argument  for  the  junior  high  school.  Those  who  urge  the  theory  of  gradual  develop- 
ment would  be  inclined,  no  doubt,  to  challenge  a  program  that  would  impose  upon 
later  childhood  a  school  in  which  the  pupils :  (1)  "Need  much  drill,  habituation,  authority, 
and  memory  work;"  and  then  suddenly  offer  a  school  for  pre-adolescents  (12  to  15) 
in  which  pupils  are  to  have  a  "New  Freedom"  because  (2)  "As  adolescence  slowly  super- 
venes and  boyhood  is  molted,  the  method  of  freedom  and  appeal  to  interest  and  spon- 
taneity should  be  increased.  If  there  is  any  genius  or  talent,  enthusiasm  for  work  or 
ideals,  they  begin  to  be  felt."  (Cited  by  the  author  as  a  basic  principle  from  Dr. 
Hall's  Youth:  Its  Education,  Regimen  and  Hygiene,  p.  359.) 

The  striking  thing  in  this  contrast  is  not  the  desirability  of  the  new  school  with  its 
new  procedure  for  the  junior  high-school  boys  and  girls,  designed  to  release  personality 
and  unfold  individuality  under  freedom  regulated  by  law,  but  rather  in  the  denial  of  a 
similar  emancipating  program  for  later  childhood,  or  for  that  matter,  any  other 
administrative  unit  in  the  whole  range  of  education.  It  does  not  seem  to  be  a  valid 
or  valuable  theory  of  education  that  would  restrict  one  period  of  education  (whether 
later  childhood  or  that  of  college  after  the  high  school)  by  imposing  a  rigid  formalism — a 
memorizing,  lesson-hearing  school,  and  then  attempt  to  find  a  "Path  to  Freedom"  in 
some  subsequent  period.  Pupils  of  later  childhood  may  be  so  badly  corrupted  in  the 
lesson-hearing  school  that  a  procedure  for  releasing  personality  cannot  be  economically 
and  productively  developed  in  the  subsequent  period. 

Another  major  criticism  is  offered  not  because  the  author  does  not  make  a  good  case 
for  a  certain  group  of  "constants"  in  secondary  education — English,  social  studies, 
history — but  rather  because  he,  in  common  with  a  number  of  writers,  is  failing  to  give 
proper  emphasis  to  other  major  fields  of  secondary  education,  particularly  science  and 
mathematics,  as  basic  work  for  all  pupils  in  our  secondary  schools.  Certainly  the 
technic  of  our  modern  civilization  is  science.  The  tools  of  science  are  comparatively 
new.  In  order  to  understand  and  appreciate  the  problems  of  our  modem  Ufe,  and  in 
order  to  build  our  civilization — socially,  economically,  nationally,  internationally — the 
people  of  a  democracy  must  be  famiharized  with  the  tools  and  the  method  of  science. 
There  is  abundant  argument  to  support  the  view  that  science  should  be  a  universally 
known  and  appreciated  as  the  English  language  itself.  It  is  not  enough  to  say  that 
only  a  limited  number  of  trained  experts  will  be  required.  There  is  no  way  of  selecting 
them  in  advance  of  the  experiment.  Moreover  the  common  man  needs  to  know  what 
his  specialist  is  about,  and  to  appreciate  expert  and  trained  leadership.  Science, 
including  mathematics,  is  a  definite  and  an  invaluable  contribution  toward  a  common 
knowledge  and  toward  a  general  appreciation  of  American  life. 

The  proper  development  of  the  physical  sciences  requires  secondary  school  mathe- 
matics.   No  "hit  and  miss"  election  of  such  an  important  subject  can  be  defended. 

With  a  rational  development  of  the  project  method,  and  socialized  procedure,  the 
constructive  arts  may  gain  a  commanding  emphasis  in  the  secondary  school  among 
the  "constants."  At  all  events,  it  does  not  seem  wise  to  foster  a  dogmatic  or  limited 
view  of  any  irreducible  minimum.  The  tendency  to  emphasize  a  few  common  courses 
of  studies  is  a  definite  reaction  against  a  growing  practice  of  loose  and  uncoordinated 
election. 

The  author  reflects  the  well-known  attitude  of  Dr.  Hall  toward  the  foreign  lan- 
guages, particularly  the  classical  group. 

As  a  whole,  this  volume  is  a  stimulating  challenge.  Material  of  current  interest  is 
assembled  and  the  writer  defends  his  theses  with  enthusiasm. 

University  High  School,  H.  L.  Miller 

Madison,  Wisconsin 


SELECTING  A  PLAY 

Drama  League  or  America.  List  of  plays  for  high  school  and  college  production, 
edited  by  committees  from  the  Drama  League  and  the  National  Council  of 
Teachers  of  English.  Washington,  D.  C.  (306  Riggs  Building):  Drama  League 
of  America,  1916. 

Drury,  F.  K.  W.    Some  of  the  best  dramas.    New  York:  H.  W.  Wilson  Company,  1917- 

This  list  consists  of  plays  which  have  been  acceptable  as  acting  drama  in  their  own  age.  There 
are  also  many  other  bits  of  advice  included.  It  will  not  only  be  useful  in  the  selection  of  a  play  but 
may  be  useful  in  classes  in  English. 

Hill,  Frederick  T.    High  school  farces.    New  York:  Frederick  A.  Stokes,  1920. 
Johnson,  Gertrxide  E.    Choosing  a  play.    New  York:  Century  Company,  1920. 

This  is  probably  the  best  book  published  on  the  subject. 

Part  I  of  the  book  takes  up  the  problems  of  the  theater  as  an  educational  institution,  dramatic 
production  and  the  educational  curriculum,  why  the  one  act  play,  dramatics  in  the  high  school, 
the  place  of  pageantry  in  community  life,  notes  on  acting,  material  for  prodiiction. 

Part  II  gives  the  addresses  of  play  publishers  and  brokers,  lists  of  plays  (graded),  Christmas 
plays,  plays  for  women  actors,  one-act  plays  in  pamphlet  form,  one-act  plays  for  male  characters, 
books  of  one-act  plays,  plays  possible  for  out-door  production,  plays  for  study  and  scene  work,  books 
of  plays  for  children,  other  bibliographical  lists,  magazines  and  periodicals  of  assistance,  books  and 
articles  on  pageantry,  books  and  articles  on  dramatization  in  school  work,  and  books  about  the 
theater  and  acting. 

Kaplan,  Samuel.    Actable  one-act  plays.    Chicago:  Chicago  Public  Library,  1916. 
Merry,  Glenn  N.    High  school  plays.    A  compilation  of  data  concerning  plays  recently 

presented  in  Iowa  schools.    (State  University  of  Iowa,  Extension  Division  Bulletin 

No.  18.)    Iowa  City,  la.:  State  University  of  Iowa,  1916. 

This  bulletin  opens  with  an  introduction  telling  how  the  list  of  plays  was  obtained,  cost  of 
plays,  etc.;  but  m.ost  important  is  the  list  of  plays  which  follows  the  introduction.  For  each  play  is 
given  the  title,  author,  publisher,  classification  as  to  whether  it  is  a  comedy,  farce,  or  tragedy, 
number  of  stage  settings,  number  of  male  and  female  characters,  and  the  grade  of  satisfaction  which 
the  play  gave  the  community.  This  list  of  plays  is  followed  by  the  list  of  publishers  with  a. Id 
and  also  a  list  of  costume  houses. 

Oglebay,  Kate.     Plays  for  children.      A  selected  list.      New  York:        ..    Wilson 

Company,  1920. 

This  is  a  list  of  plays  suitable  for  children  from  six  to  sixteen  years  of  age.  This  list  also  contains 
lists  of  reference  books,  books  about  costumes  and  scenery,  books  of  stories  and  p.ograms  for  story- 
telling, story-playing,  readings  and  recitations,  dramatic  readers,  plays,  books  of  plays,  plays  for 
Christmas,  and  plays  for  other  holidays. 

Margaret  Doherty 
Bureau  of  Educational  Research, 
University  of  Illinois 

THE  SELECTION  OF  TEXTBOOKS 

I.  General  References 
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Cast,  G.  C.    "Selecting  textbooks,"  Elementary  School  Journal,  19:468-72,  February, 
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Dewey,  Henry  B.     "Adoption  and  purchase  of  textbooks,"  American  School  Board 
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Doughton,  Isaac.     "Choosing  textbooks,"  American  School  Board  Journal,  55:29-30, 

November,  1917. 

Mr.  Doughton,  superintendent  of  schools  at  Phoenixville,  Pennsylvania,  discusses  the  pi.  n 
which  is  followed  in  their  system. 
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Hall-Quest,  Alfred  L.     The  textbook.    Hoiv  to  use  and  judge  it.    New  York:  Macmillan 

Company,  1913.     265  pp. 

Chapter  iv  discusses  the  selection  and  judgment  of  textbooks.    A  score  card  is  reproduced. 
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Mead,  Cyrus  D.    "The  best  method  of  selecting  textbooks,"  Educational  Administra- 
tion and  Supervision,  4:61-69,  February,  1918. 

This  is  a  discussion  of  the  Cincinnati  plan  of  selecting  textbooks.  It  also  gives  the  points  to 
be  considered  in  judging  texts  in  arithmetic,  reading,  spelling,  physiology,  geography,  and  language. 

'School  books  and  eyesight,"  School  and  Society,  3:608,  April  22,  1916. 

A  report  of  the  committee  of  the  British  Association  for  the  Advancement  of  Science  on  the 
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concerns  the  size  of  type  suitable  for  children  of  various  ages.  Specimens  of  each  size  of  type 
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Hall-Quest,  Alfred  L.     The  textbook.    How  to  use  and  judge  it.    New  York:  Macmillan 
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Mead,  Cyrus  D.    "The  best  method  of  selecting  textbooks,"   Educational  Adminis- 
tration and  Supervision,  4:61-69,  February,  1918. 
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Trilling,  Mabel  B .   Home  economics  in  A  merican  schools.     (Supplementary  Educational 
Monographs,  v.  2,  no.  6,  October,  1920),  pp.  28-52. 

D.  Economics 
Robinson,  L.  N.    "Textbooks  in  economics,"  School  and  Society,  4:990-93,  December 
30,  1916. 

E.  Geography 
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III.  Score  Cards 
Hall-Quest,  Alfred  L.    The  textbook.   How  to  use  and  judge  it.    New  York:  Macmillan, 

1918. 

On  page  96  a  score  card  is  reproduced.  This  score  card  was  originally  devised  by  Mr.  L.  L. 
Forsythe  to  be  used  in  connection  with  arithmetic  texts;  it  is  also  adaptable  for  texts  in  the  other 
subjects. 

Stoops,  R.  O.    "The  use  of  score  cards  for  judging  textbooks,"  Illinois  State  Teachers^ 

Association.    Journal  of  Proceedings,  1917,  p.  114-19;  also  in  American  School 

Board  Journal,  56:21-22,  March,  1918. 

Mr.  Stoops  has  devised  a  score  card  for  reading,  language,  and  spelling  textbooks. 

Ginn  and  Company  (15  Ashburton  Place,  Boston,  Massachusetts)  has  published  an 

"Arithmetic  Score  Card." 
The  Chicago  Board  of  Education  has  worked  out  a  score  card  for  geography,  language 

and  other  subjects. 

Margaret  Doherty 
Bureau  of  Educational  Research, 
University  of  Illinois 
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communications  on  similar  topics,  preferably  of  not  more  than  five  hundred 
words.  These  communications  will  be  printed  over  the  signatures  of  the 
authors.  Address  all  correspondence  concerning  this  department  to  Walter 
S.  Monroe,  University  of  Illinois,  Urbana,  Illinois. 


Assistant  Superintendent  Joseph  P.  O'Hem  of  Rochester  has  been  directing  the 
work  of  a  committee  of  principals  and  teachers  in  an  effort  to  agree  upon  the  different 

aims  to  be  met  in  the  teaching  of  reading.  The  result  of  the  efforts  of 
Objectives  this  committee  has  been  the  formulation  of  a  chart  entitled  "Attainments 
in  Reading     in  Reading."    This  chart  gives  for  the  kindergarten  and  each  of  the 

first  six  grades,  specific  objectives  together  with  suggestions  for  attaining 
them.  A  copy  of  the  chart  has  been  furnished  each  teacher  throughout  the  city  of 
Rochester;  and  the  chart  is  displayed  on  the  walls  of  each  classroom.  Superintendent 
O'Hem  has  a  few  extra  copies  which  he  is  distributing  as  long  as  they  last.  He  is 
soliciting  criticisms  from  teachers  and  school  oflBcials  with  a  view  to  revising  the 
chart  next  year. 

Monroe's  Standardized  Silent  Reading  Test,  Form  1,  was  given  to  17,400  Denver 

school  children  on  October  29,  1919.    Form  2  of  the  same  tests  was  given  on  May  27, 

1920.    A  report  prepared  by  Mrs.  Emma  M.  Brown,  Director  of 

Reading  Tests     Measurements  and  Standards,  covering  the  two  applications  of 

at  Denver  these  tests,  has  been  received.    In  it  the  following  comments  are 

made: 

"The  improvement  is  most  satisfactory  and  great  credit  is  due  to  both  principals 
and  teachers  for  the  very  effective  work  which  has  been  done.  The  city  medians  for 
speed  in  all  grades  have  been  brought  above  the  standard  although  much  more  can  be 
accomplished  in  the  lower  grades  by  the  application  of  newer  methods.  The  medians 
for  comprehension  are  above  the  standards  for  all  grades  with  the  exception  of  the 
fourth  and  fifth  and  even  here  much  improvement  has  been  made  since  September. 

"There  is  still  wide  divergence  between  the  performance  of  the  different  schools. 
In  grade  niB  the  school  with  the  best  record  has  made  a  median  score  of  12.7  while 
the  grade  with  the  poorest  score  has  made  a  median  of  3.  This  difference  is  true  for  all 
grades.  In  many  schools  there  has  been  a  marked  improvement  in  the  regularity  of 
progression  from  grade  to  grade;  but  in  some,  however,  we  still  find  the  sixth  grade 
doing  better  work  than  the  seventh,  or  the  third  grade  doing  better  work  than  the 
fourth." 

In  the  September  1920  issue  of  the  Journal  of  Educational  Research,  Dr. 
Walter  S.  Monroe  presents  a  report  of  educational  research  in  cities  of  over  10,000.  In  a 
table  Dr.  Monroe  gives  the  number  of  cities  in  each  state  (except  Delaware,  Nevada, 

North  Dakota  and  Tennessee)  making  systematic  use  of  stand- 
"Can  We  Lift  ardized  tests  or  other  scientific  methods  in  their  school  systems 

Ohio  22  Notches?"^  and  also  the  number  making  irregular  use  of  such  tests  and 

methods.    The  22  cities  in  which  members  of  the  National  Asso- 

i  This  statement  was  prepared  for  distribution  at  the  School  Administrators'  Conference  held  on 
October  30, 1920. 
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WHERE  DOES  OHIO  STAND? 


Rank 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 


Rank  A 


State 


Wyoming 

Nebraska 

Minnesota 

Kansas 

Colorado 

Washington 

Arkansas 

New  Mexico 

Oklahoma ( 

Wisconsin 

Michigan 

California 

Kentucky 

Missouri 

New  Jersey 

Virginia 

Idaho 

Illinois 

Louisiana 

Mississippi 

Montana 

Pennsylvania 

Ohio 

Oregon 

Vermont 

Iowa 

Connecticut 

Indiana ; . . 

New  York 

Florida 

New  Hampshire .  . 
Massachusetts  .  .  . 
West  Virginia .... 

Maine 

North  Carolina.  .  . 

Texas 

Alabama 

Arizona 

Dist.  of  Columbia . 

Georgia 

Maryland 

Rhode  Island 

South  Carolina .  .  . 
South  Dakota . . . . 
Utah 


Per- 
cent 


80 
60 
46 
45 
44 
42 
33 
33 
33 
33 
31 
30 
30 
30 
30 
30 
29 
29 
29 
29 
29 
29 
25 
25 
25 
20 
17 
17 
15 
14 
13 
11 
11 
10 
08 
04 
00 
00 
00 
00 
00 
00 
00 
00 
00 


RankB 


Rank 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 


State 


Wyoming 

Nebraska  .^"«v^.  .  . . 

California 

Arkansas 

Colorado 

Oklahoma 

Minnesota 

Oregon 

Wisconsin 

Kansas 

Louisiana 

Montana 

New  Jersey 

Washington 

Kentucky 

Michigan 

Mississippi 

New  Hampshire .  . 

Illinois 

Pennsylvania 

New  Mexico 

Ohio 

West  Virginia .... 

Virginia 

Idaho 

Mississippi 

Connecticut 

Massachussetts .  .  . 

Indiana 

Vermont 

New  York 

Iowa 

South  Dakota .  .  .  . 

Texas 

South  Carolina.  .  . 

Florida 

Alabama 

Rhode  Island 

Maine 

North  Carolina.  .  . 

Georgia 

Arizona 

Dist.  of  Columbia . 

Maryland 

Utah 


Director,  Extension  Department, 
Ohio  University,  Athens,  Ohio 


R.  L.  Morton 
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ciation  of  Directors  of  Educational  Research  are  in  charge  of  this  iypt,  of  work  were 
not  included. 

We  have  drawn  upon  Dr.  Monroe's  table  for  the  data  involved  in  the  rankings 
on  the  accompanying  sheet.  In  making  our  calculations  we  have  assumed  that  the 
22  cities  referred  to  make  systematic  use  of  such  tests  and  have  included  them.  We 
have  also  assumed  that  all  cities  making  use  of  tests  replied  to  Dr.  Monroe's  letter — a 
doubtful  assumption.    A  total  of  253  cities  are  involved. 

Rank  A  5'::'^es  the  percent  of  cities  in  each  state  making  systematic  use  of  tests. 
Rank  B  ^ives  the  percent  making  any  use  of  the  tests,  systematic  or  irregular.  Thus 
25  percent  of  the  cities  of  over  10,000  in  Ohio  (12)  make  systematic  use  of  tests  and 
33  percent  (16)  make  some  use  of  them,  four  of  the  16  using  them  irregularly. 

Ohio  occupies  a  median  position  in  each  column. 

The  rankings  reveal  very  clearly  the  progressive  tendency  of  the  west  and  the 
conservatism  of  the  east  and  south. 

School  administrators  quite  generally  recognize  that  the  marks  assigned  to 
pupils  should,  under  average  conditions,  distribute  themselves  in  close  conformity 
to  the  normal  surface  of  frequency.  Practices  differ  as  regards 
The  Normal  *    the  number  of  intervals  into  which  marks  are  distributed  and  also 

Distribution  of  as  regards  the  percent  which  it  is  thought  desirable  to  have  in 

School  Marks  each  interval.    A  distribution  of  marks  into  five  intervals,  A,  B, 

C,  D,  and  E,  is  frequently  found.  This  plan  has  the  advantage  of 
using  as  its  unit-basis  a  commonly  employed  measure  of  variability,  the  standard  devia- 
tion. Under  normal,  average  conditions  with  a  large  number  of  pupils  approximately 
7  percent  should  be  very  superior  or  A's,  24  percent  superior  or  B's,  38  percent  average 
or  C's,  24  percent  inferior  or  D's,  and  7  percent  very  inferior  or  E's. 

The  writer  has  found  it  necessary  in  making  comparative  studies  of  distributions 
of  school  marks  to  employ  a  formula  that  will  make  possible  a  close  comparison  of  the 
normality  of  two  or  more  distributions. 

Let  us  illustrate  with  the  marks  contained  in  the  accompanying  table: 


Interval 

Number 

Percent 

Normal 

Deviation 

Error 

A 

23 

15.9 

7 

+8.9 

9.6 

B 

50 

34.5 

24 

+  10.5 

13.8 

C 

44 

30.3 

38 

-7.7 

20.3 

D 

18 

12.4 

24 

-11.6 

48.3 

E 

10 

6.9 

7 

-0.1 

1.4 

Total 

145 

100.0 

100 

93.4 

Of  the  145  marks  assigned,  23  (15 .9  percent)  are  A's,  50  (34 . 5  percent)  are  B's,  etc. 
Comparing  these  percents  with  the  normal  in  the  adjacent  column  we  find  that  there 
is  an  excess  of  8 . 9  percent  in  the  A  interval  and  of  10 . 5  percent  in  the  B  interval.  But 
in  the  C,  D,  and  E  intervals  there  is  a  deficit  so  we  have  placed  minus  signs  before  the 
deviations  for  these  intervals. 
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Now  the  magnitude  of  the  error  in  any  interval  is  judged  by  comparing  the  actual 
deviation  with  the  greatest  possible  deviation  in  the  direction  in  which  the  deviation  is 
made.  In  the  A  interval,  for  example,  obviously  the  greatest  possible  positive  devia- 
tion occurs  when  all  the  marks  are  A's.  In  such  an  extreme  case  the  deviation  would  be 
+93.  Then  the  A  error  is  determined  by  comparing  8 . 9  with  93.  But  8 . 9  is  9 . 6  per- 
cent of  93.  In  like  manner  we  find  the  B  deviation,  10 . 5,  to  be  13 . 8  percent  of  76,  the 
greatest  possible  deviation  in  the  direction  in  which  the  deviation  occurs.  The  C  devia- 
tion, however,  is  a  negative  deviation.  The  quantity  7.7  is  20.3  percent  of  38,  the 
greatest  possible  deviation  in  the  direction  in  which  the  deviation  occurs.  In  this 
case  the  greatest  possible  deviation  is  realized  when  no  one  in  the  class  or  school  is 
assigned  this  mark.  The  errors  in  the  D  and  E  intervals  are  computed  in  exactly  the 
same  way  as  was  that  in  the  C  interval.  The  quantity  11 . 6  is  48 . 3  percent  of  24  and 
the  quantity  0 . 1  is  1 . 4  percent  of  7. 

The  error  of  the  distribution  then  may  be  expressed  by  the  following  formula: 
E  =  2e=93.4  =  18.7. 
n        5 

The  coefficient  of  accuracy, 

yl-100-£=100-18.7  =  81.3. 

Of  course  this  method  may  be  applied  to  a  system  of  rating  which  distinguishes 
any  number  of  marks — e.q.,  a  three-point  or  a  seven-point  system.  The  normal  dis- 
tribution of  marks  for  such  a  system  must  first  be  determined  from  a  table  showing  the 
fractional  parts  of  the  area  under  the  normal  probability  curve.  For  a  three-point 
system  this  distribution  in  terms  of  percent  of  marks  would  be  16,  68,  16;  for  a  seven- 
point  system,  2,  8,  23.5,  33,  23.5,  8,  2. 

Director,  Extension  Department,  R.  L.  Morton 

Ohio  University,  Athens,  Ohio 

The  Barr  Diagnostic  Tests  in  American  History,  Series  2A  and  2B,  have  recently 
been  published  by  the  Bureau  of  Educational  Research.^  These  tests  represent  a  new 
attack  upon  the  problems  of  measuring  ability  in  the  field  of  history. 

There  are  five  tests:  (1)  comprehension,  (2)  chronological  judg- 
Barr's  Diagnostic  ment,  (3)  historical  evidence,  (4)  evaluation  of  facts,  and  (5) 
Tests  in  American  causal  relationships.  When  the  history  pupil  is  confronted  with 
History  the  printed  page  he  must  first  read  and  understand  the  material 

placed  before  him.  History  is  a  reading  subject,  but  differs  from 
general  reading  in  that  it  employs  historical  background  and  a  technical  language. 
Then,  secondly,  the  really  "historically  minded"  person  asks:  "Are  the  facts  here 
stated  true?"  Pupils  frequently  pass  over  this  step  with  a  vague  general  feeling  that 
all  printed  facts  are  true.  The  third  inquiry  is:  "Is  the  fact  important?"  Even  the 
most  immature  pupil  will  make  some  selection.  Few  choose  to  memorize  the  text 
verbatim.  The  fourth  step  is  to  place  the  facts  in  time  order.  The  facts  of  history  are 
peculiar  in  that  they  are  all  placed  in  a  definite  time  relationship.  When  taken  out  of 
this  time  relationship  they  lose  their  historical  significance.  And  finally  the  facts  of 
history  must  be  studied  in  their  relation  to  other  facts.  The  facts  of  history  are  not 
isolated  facts,  but  rather  trains  of  facts  tied  in  causal  relations.  Five  tests  are  given — 
each  to  measure  one  of  these  five  fundamental  processes. 

1 A  copy  of  these  can  be  obtained  from  the  Public  School  Publishing  Company,  Bloomington,  Illinois, 
who  are  distributing  them  under  the  auspices  of  the  Bureau  of  Educational  Research,  University  of  Illinois, 
Urbana,  Illinois. 
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While  the  information  factors  have  not  been  entirely  eliminated,  the  tests  deal, 
in  the  main,  with  general  historical  information  rather  than  with  specific  facts.  Al- 
though the  tests  deal  with  abilities  rather  than  specific  facts  they  are  not  designed  to 
measure  native  historical  ability  or  general  intelligence  but  include  school  training, 
home  training,  and  previous  experience — the  sum  total  of  abilities — in  so  far  as  these 
abilities  bear  upon  the  ability  to  do  these  particular  exercises.  While  the  tests  may 
be  used  to  measure  achievement  in  history,  they  aim  primarily  to  aid  the  teacher  in 
giving  more  intelligent  classroom  instruction  by  diagnosing  the  particular  need  of  the 
individual  pupil. 

The  tests  have  been  three  times  revised,  but  not  standardized.  It  is  hoped  that 
more  definite  weightings  of  the  different  questions  can  be  supplied  in  the  near  future. 

While  measurement  of  content  is  not  directly  aimed  at  in  these  tests,  the  content 
is,  however,  based  upon  the  available  studies  on  the  content  in  American  history 
including  Bagley  and  Rugg.  In  the  main  only  the  larger  and  more  important  facts  in 
American  history  have  been  included. 

With  the  great  increase  in  the  number  and  extent  of  educational  and  intelligence 
tests,  school  administrators  and  teachers  are  confronted  with  a  real  problem.    This  is 
to  find  the  time  to  give  the  tests.    A  school  day,  already  too 
Illinois  Standardized      short,  must  either  be  lengthened  or  some  part  of  the  regular 
Algebra  Test  work  must  be  set  aside.    A  second,  though  perhaps  minor 

difl&culty,  is  the  expense  involved  in  the  purchase  of  tests. 
Many  school  authorities,  at  present  facing  a  financial  crisis,  are  compelled  to  practice 
the  severest  of  economy.  It  therefore  seems  that  the  devisers  of  tests  should  give 
consideration  to  these  factors. 

At  present,  algebra  seems  to  be  a  field  which  affords  an  opportunity  for  a  test 
relatively  inexpensive  and  requiring  but  a  short  time  to  administer.  The  Bureau  of 
Educational  Research  of  the  University  of  Illinois  has  recently  made  available  such  a 
test.i  It  was  devised  by  Professor  W.  S.  Monroe  and  Mr.  Lewis  W.  Williams.  It  is 
based  upon  the  simple  equation  since  the  simple  equation,  the  processes  it  involves 
and  the  processes  involving  it,  constitute  a  very  large  part  of  the  work  of  the  first  year 
in  algebra. 

The  test  consists  of  four  parts,  each  of  which  contains  twenty  exercises.  In  part 
one,  the  two  unknown  quantities  are  in  the  first  member  of  the  equation;  in  parts  two, 
three,  and  four,  there  is  one  unknown  in  each  member.  Part  three  differs  from  part 
two  in  that  it  involves  the  parenthesis.  In  part  four,  the  fractional  form  is  found  in 
both  members  of  the  equation.  The  test  can  easily  be  given  within  a  single  class 
period.  Four  minutes  are  allowed  for  part  one,  five  for  part  two,  nine  for  part  three, 
and  ten  for  part  four.  This  permits  twelve  minutes  out  of  a  forty-minute  period  to  be 
devoted  to  directions,  passing  and  collecting  papers,  and  the  usual  interruptions. 

The  cycle  arrangement  is  used  in  each  part,  each  of  which  consists  of  five  cycles 
of  four  members  each.    These  members  differ  from  each  other  in  the  arrangement  of 

>  Copies  of  this  test  may  be  secured  from  the  Public  School  Publishing  Company,  Bloomington,  Illi- 
nois, which  is  distributing  them  under  the  auspices  of  the  Bureau  of  Educational  Research  of  the  University 
of  Illinois. 
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the  signs.    The  following  arrangement  is  carried  out :  -\ 1 — ,  — \--\ —  ,+-| , 

and  -\ 1-.    The  general  plan  may  be  illustrated  as  follows: — 

Parti:  ±ax±bx=  ±c±d 

Part  II:  ±ax±c=  ±hx±d 

Part  III:  ±k{±ax±c)  =  ±hx±d 

Part  IV:  ±±ox±c=  j^±hx±d 

Ml  »2 

From  inspection  it  is  evident  that  there  are  many  combinations  of  signs  which 
might  be  used,  particularly  in  parts  three  and  four.  The  above  plan  was  arbitrarily 
chosen.  Variations  are  produced  by  changing  the  relative  size  of  the  numerical  coeffi- 
cients of  the  unknowns  as  regards  the  knowns.  The  cycle  arrangement,  accurately 
carried  out,  may  produce  results  showing  diagnostic  properties  inherent  in  the  test. 
Evidence  of  this  appeared  quite  clearly  in  preliminary  trials.  For  example,  if  some 
member  of  a  cycle  really  represents  a  distinct  type  of  problem,  a  pupil  missing  it  in 
the  first  cycle  would  be  apt  to  miss  the  corresponding  member  in  at  least  a  majority 
of  the  other  cycles.  If  after  the  test  has  been  submitted  to  a  large  number  of  pupils, 
results  show  this  tendency  holds  throughout  the  test,  much  assistance  will  be  given 
to  the  teacher.  In  any  event,  the  test  has  general  properties  which  seem  to  justify  its 
appearance. 

The  Illinois  Standardized  Algebra  Test,  as  it  is  called,  has  recently  been  placed 
in  the  hands  of  teachers  to  be  given  to  six  hundred  pupils.  As  soon  as  results  are 
available,  tendency  standards  will  be  issued.  Standards  will  be  set  up  for  pupils 
who  have  had  one  semester  of  work  in  algebra,  as  well  as  for  those  who  have  had  two 
and  three,  respectively. 
University  of  Illinois  Lewis  W.  Williams 

r 
The  following  quotation  is  taken  from  the  Detroit  Educational  Bulletm  fo 

November  1920.     It  is  reprinted  here  partly  because  of  the  general  interest  in  intelli- 
gence tests  and  partly  because  it  illustrates  a  well  thought-out 
Use  of  a  FIrst-Grade      method  of  making  use  of  the  results  of  these  tests. 
Intelligence  Test  "Under  the  direction  of  the  Psychological  Clinic,  more  than 

in  Detroit  ten  thousand  B  I  pupils  were  given  a  group  intelligence 

examination  during  September  1920.  The  examination  was 
given  by  sixty  special  class  teachers,  assisted  by  members  of  the  Psychological  Clinic. 
The  test  used  is  known  as  the  Detroit  First  Grade  Intelligence  Test,  which  was  devised 
by  the  Psychological  Clinic  during  the  past  school  year.  The  ten  thousand  pupils 
examined  were  classified  approximately  as  follows :  the  8%  receiving  the  highest  score 
were  given  an  intelligence  rating  of  A;  the  next  12%,  B;  the  next  18%,  C-f;  the  next 
24%,  C;  the  next  18%,  C - ;  the  next  12%,  D;  and  the  last  8%,  E.  In  other  words,  20% 
of  the  children  tested  were  given  A  or  B  ratings,  60%,  C-1-,  C,  or  C—  ratings,  and 
20%,  D  or  E  ratings.  In  this  examination,  less  than  one-half  of  one  per  cent  of  the 
pupils  tested  made  a  zero  score  and  no  pupil  made  a  perfect  score.  It  is  interesting  to 
note  the  extent  to  which  different  schools  vary  in  respect  to  the  ability  of  B  I  pupils. 
In  several  schools  there  were  no  pupils  who  received  a  grade  of  E  or  D,  while  in  certain 
other  schools  there  were  no  pupils  receiving  B  or  A  grades. 

"A  letter  from  the  Superintendent  of  Schools  was  sent  to  the  principal  of  each 
school  along  with  the  intelligence  ratings  of  the  B  I  pupils.    The  letter  from  the  Super- 
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intendent  recommends  that  the  intelligence  ratings  be  used  in  one  or  more  of  the 
following  ways : 

"1.  Arrange  the  pupils  in  three  groups,  the  groups  to  be  known  as  Groups  X,  Y 
and  Z;  Group  X  to  consist  only  of  pupils  with  an  intelligence  rating  of  A  or  B;  Group  Y 
to  consist  only  of  pupils  with  an  intelligence  rating  of  C+,  C  or  C  — ;  and  Group  Z  to 
consist  only  of  pupils  with  an  intelligence  rating  of  D  or  E.  By  this  method,  X,  Y  and 
Z  will  always  designate  pupils  of  about  the  same  grade  of  ability  regardless  of  the 
school  in  which  they  might  be  found.  If  for  any  reason,  you  do  not  find  it  advisable  to 
follow  the  grouping  suggested,  you  should  designate  the  groups  that  you  may  form  by 
s)anbolo  other  than  X,  Y  or  Z.  The  X,  Y  and  Z  groups  in  the  B  First  are  to  be  desig- 
nated as  I  B-X,  I  B-Y  and  I  B-Z.  The  assignment  by  letter  ratings  of  pupils  to 
Groups  X,  Y  and  Z  is  to  be  considered  tentative.  You  have  the  authority  to  transfer 
a  pupil  from  one  group  to  another  as  soon  as  you  are  convinced  that  the  pupil  is  not 
properly  classified,  provided  you  keep  a  record  of  the  number  of  and  the  reasons  for 
such  transfers,  in  order  that  the  Clinic  may  have  definite  information  as  to  the  accuracy 
of  its  classification.  The  Psychological  Clinic  stands  ready  to  assist  you  in  the  more 
accurate  classification  of  the  apparent  misfits  by  individual  examination. 

"The  pupils  who  are  found  to  be  able  to  do  more  work  than  is  required  of  the 
group  to  which  they  belong  are  to  be  transferred  to  the  next  higher  group,  those  who 
cannot  do  the  work  of  the  group  to  which  they  belong  will  be  transferred  to  the  next 
lower  group,  and  those  who  cannot  keep  up  with  the  lowest  group,  or  Group  Z,  will  be 
considered  candidates  for  the  special  classes  and  will  be  given  an  individual  examina- 
tion by  the  Psychological  Clinic.  It  is  suggested  in  this  connection  that  the  unassigned 
or  coaching  teachers  could  be  of  marked  assistance  in  helping  classify  the  apparent 
misfits. 

"The  principals  who  adopt  this  method  of  classification  are  encouraged,  under  the 
direction  of  the  Department  of  Educational  Research,  to  work  out  courses  of  study  for 
the  X  and  Z  groups,  an  enriched  course  of  study  for  the  X  Group,  and  a  course  in 
minimum  essentials  for  the  Z  Group.  In  schools  where  there  are  not  enough  A  and 
B  or  D  and  E  pupils  for  a  single  room,  it  is  suggested  that  two  groups  be  placed  in  the 
same  room,  or  that  like  groups  from  adjacent  schools  be  put  together. 

"2.  In  schools  where  all  the  pupils,  because  of  congested  conditions,  cannot  attend 
full  time,  the  intelligence  ratings  can  be  used  to  select  the  puoils  that  stand  most 
in  need  of  full  time  instruction.  It  is  believed  that  the  pupils  with  an  intelligence 
rating  of  A,  B  and  C-f-  might  be  so  grouped  and  the  course  of  study  so  organized  that 
they  would  actually  accomplish  mored  uring  a  half-day  session  than  they  are  now  able 
to  accomplish  during  a  full  day  session  in  the  schools  where  the  congestion  is  the  great- 
est. 

"3.  In  small  schools  where  there  are  only  a  few  cases  of  pupils  securing  an  A  or 
B  rating,  these  pupils  might  be  given  special  help  by  the  unassigned  teacher  in  order 
that  they  may  pass  quickly  into  the  A  first  grade.  This  method  was  used  to  advantage 
in  one  or  two  of  the  schools  last  year  where  the  first  grade  children  were  classified 
by  means  of  intelligence  tests.  In  the  schools  where  there  are  only  a  few  pupils  who 
receive  a  D  or  E  rating,  the  unassigned  teacher  could  to  advantage  give  these  pupils 
special  attention  in  order  that  the  special  class  cases  might  receive  an  individual  psycho- 
logical examination  as  soon  as  possible." 


Natinnal  AHfioriattcn  nf  itr^rtrrris  nf 
lEbturattnnal  ^tBmvti\ 

(E.  J.  AsHBAUGH,  Secretary  and  Editor) 


Do  You  Know 

That  Standardized  Tests  are  most  valuable  for  Diagnostic  Purposes? 

A  good  physician  always  diagnoses  each  important  case  before  giving  advice 
and  repeats  certain  parts  of  his  diagnosis  from  time  to  time  to  determine  the  progress 
of  the  case. 

In  like  manner,  a  good  teacher  at  the  beginning  of  the  year  diagnoses  each  pupil 
sent  her  and  repeats  certain  parts  of  her  diagnosis  from  time  to  time  to  determine 
progress. 

The  physician  has  far  more  accurate  instruments  and  tests  for  diagnosis  than  he 
had  a  few  decades  ago.  Hence,  his  data  are  now  more  accurate,  his  advice  more 
valuable,  and  his  success  greater.  So  in  the  realm  of  teaching,  improved  instruments 
for  diagnosis  have  been  devised.  The  last  decade  has  seen  the  development  of  the 
standardized  tests  of  pupil  achievement.  These  tests  are  superior  for  diagnostic  pur- 
poses to  the  tests,  measures,  and  examinations  devised  by  the  teacher,  principal  or 
other  school  officials.    Their  superiority  depends  chiefly  upon  two  factors: 

1.  The  standardized  tests  are  more  objective.  Hence,  the  results  are  fairer  and 
more  impersonal, 

2.  They  are  standardized  by  grades.  Hence,  by  the  application  of  these  tests 
and  the  comparison  of  the  results  with  the  grade  norms  or  standards,  the  teacher 
may  know  whether  each  pupil  whom  she  receives  is,  in  general,  up  to  standard  for  his 
grade  when  she  receives  him;  she  may  also  know  in  which  subjects  each  pupil  is  below, 
and  in  which  subjects  above,  standard.  Good  teaching  begins  with  what  the  child 
Knows  and  Is.    Hence,  the  need  for  accurate  diagnosis. 

During  the  year  1918-1919  many  teachers  in  the  Kansas  City  schools  used 
standardized  tests  for  diagnostic  purposes  with  most  excellent  results.  This  use  of  the 
tests  has  been  so  helpful  that  the  Bureau  of  Research  and  Efficiency  is  planning  to 
make  itself  this  year  purely  a  Service  Bureau.  This  service  aims  to  accomplish  the 
following  things: 

1.  To  supply  any  teacher  or  principal  with  any  tests  he  may  need  in  his  school 
work. 

2.  To  assist  both  teachers  and  principals  in  selecting  and  giving  tests  and  in 
tabulating  and  interpreting  results. 

3.  To  cooperate  in  improving  the  organization  of  the  school,  the  classification  of 
pupils,  and  the  methods  of  teaching  so  as  to  secure  better  service  for  the  pupils. 

4.  To  confer  with  teachers  and  principals  on  any  problems,  especially  problems  of 
school  instruction,  grade  objectives  or  standards,  and  school  achievement. 

The  bureau  is  your  servant  and  exists  solely  to  assist  you  in  giving  the 

CHILDREN  THE  BEST  POSSIBLE  SERVICE.     CaLL  UPON  THE  BUREAU  FOR  ANY  SERVICE  IT 
CAN  RENDER. 

78 
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(The  above  is  a  part  of  a  circular  letter  sent  in  September  1919  to  all  teachers  and 
principals  in  the  Kansas  City  schools.  It  is  one  of  the  various  instruments  used  by 
Mr.  Melcher  and  his  assistants  in  getting  the  bureau  of  which  he  is  head  to  function 
through  the  regular  school  organization  and  render  service  to  the  children  of  the  city. 
That  the  program  was  worth  while  and  reached  at  least  some  of  its  objectives  may  be 
inferred  from  the  following  from  his  most  recent  letter:  "During  the  year  1920-21, 
it  is  planned  to  use  the  same  method  that  was  used  during  1919-20."  The  secretary 
would  welcome  copies  of  circular  letters,  bulletins,  reports,  etc.,  which  the  members 
send  to  their  principals  and  teachers,  together  with  any  comment  which  may  explain 
the  use  or  results  from  the  same. — Secretary.) 


Detroit. — Homer  W.  Anderson,  Assistant  Director  of  Educational  Research,  re- 
ports the  following  interesting  activities  of  his  department: 

1.  Have  standardized  and  given  a  typewriting  test  in  all  high  schools  of  the  city. 
Tentative  standards  are  now  available. 

2.  Developing  a  series  of  tests  in  chemistry. 

3.  Committee  of  mathematics  teachers  are  at  work  on  evaluation  of  present 
algebra  tests  with  a  view  to  using  the  most  satisfactory  or  to  developing  a  new  set. 

4.  Committees  of  high-school  teachers  under  the  direction  of  the  department  of 
research  are  carrying  on  investigations  in  foreign  languages,  science,  and  social  science. 

5.  Department  is  cooperating  in  the  formulation  of  building  program  for  the 
city. 


Oakland. — Virgil  E.  Dickson,  our  vice-president,  says  that  his  bureau  is  "con- 
tinuing the  policy  of  former  years  in  making  strong  emphasis  on  studying  the  capaci- 
ties of  children.  We  believe  that  standard  mental  tests  and  standard  pedagogical  tests 
ntust  go  hand  in  hand  in  studying  the  educational  problems  that  confront  us." 

They  will  soon  complete  the  mental  testing,  either  group  or  individual,  of  every 
child  in  the  school  system.  Comparison  of  achievement  or  pedagogical  tests  and  I.  Q. 
with  instructional  time  is  expected  to  give  a  better  check  on  quality  of  teaching  than 
was  before  possible. 

They  find  it  thoroughly  possible  in  practical  administration  to  have  classes  for 
superior,  normal,  and  retarded  groups  and  have  several  committees  at  work  on  courses 
of  study  for  different  subjects  which  shall  be  adjusted  to  this  "three-track"  plan. 


Beaumont,  Texas. — Miss  Clara  Mallory  reports  that  they  too  are  working  on 
reclassification  through  the  use  of  mental  tests.  At  the  opening  of  the  present  school 
year,  the  Otis  test  was  given  to  over  two  hundred  high-school  freshmen  and  classifica- 
tion was  made  on  the  basis  of  the  test.  Mental  ages  of  eight  to  eighteen  were  found  in 
the  group. 

The  graduating  class  from  the  eighth  grade  will  be  given  the  Otis  test  this  coming 
spring  in  order  that  classification  may  be  ready  when  school  opens  in  the  fall. 

Haggerty  Achievement  Examination  in  Reading,  Sigma  1,  was  given  for  classifi- 
cation purposes  to  children  in  grades  ii  and  in. 

Pedagogical  tests  will  be  given  at  the  beginning  of  the  second  and  fourth  quarters 
and  results  recorded  on  individual  rating  cards  as  last  year. 


80  JOURNAL  EDUCATIONAL  RESEARCH      Vol.  3,  No.  1 

Kansas  City,  Missouri. — George  Melcher,  director  of  the  bureau,  has  been  the 
president  of  the  Missouri  State  Teachers'  Association  during  the  past  year.  The  asso- 
ciation has  an  enrollment  of  fifteen  thousand;  and  the  recent  meeting  had  an  attend- 
ance of  six  thousand.  This  has  taken  much  of  the  president's  time  since  an  extensive 
publicity  campaign  for  increasing  teachers'  salaries  and  revenue  for  schools  has  been 
carried  on. 

Here  also  group  intelligence  tests  have  been  used  for  reclassification  of  pupils. 
About  five  thousand  children  have  been  tested  and  in  one  high  school  the  freshmen 
have  been  divided  into  three  groups,  superior,  average  and  inferior.  The  teachers 
know  the  rating  of  the  classes  they  teach  but  in  most  cases  the  children  do  not.  The 
same  principle  is  being  followed  in  one  large  elementary  school. 

For  the  first  time,  this  fall  the  bureau  is  testing  kindergarten  and  first-grade 
children  by  means  of  the  Stanford  Revision  of  Binet  and  adjusting  classes  in  accord- 
ance with  the  findings.    The  teachers  are  well  pleased  with  the  results. 

A  general  survey  will  be  made  this  year  of  the  whole  system  in  two  or  three 
subjects,  probably  geography,  language,  and  reading. 


Cleveland. — W.  W.  Theisen,  the  new  director,  says  that  he  "hesitates  to  say  much 
about  what  we  are  doing  as  we  are  just  getting  started."  However,  he  does  tell  a  few 
things. 

1.  Testing  entering  first  grade  pupils  in  forty  schools  with  Pressey  Primer  Scale. 

2.  Planning  to  test  all  graduating  high-school  seniors  and  incoming  junior  high- 
school  pupils  with  group  intelligence  tests. 

3.  November  2  the  electors  of  Cleveland  indorsed  a  fifteen  million  dollar  bond 
issue  and  a  special  five-year  three-mill  tax  levy  for  general  purposes.  This  was  not 
particularly  the  work  of  the  bureau  but  indicates  the  faith  the  public  has  in  its  schools. 

4.  Personally,  Dr.  Theisen  is  finishing  his  study  for  the  Yearbook  on  "Factors 
Affecting  Results  in  Primary  Reading." 


Iowa  City,  Iowa. — H.  A.  Greene  and  E.  J.  Ashbaugh  of  the  University  of  Iowa 
Bureau  of  Educational  Service  have  been  unusually  busy  this  fall  with  calls  for  definite 
service  in  the  field.  Dr.  Greene  conducted  an  intensive  survey  of  the  English  and 
mathematics  situation  in  the  eighth  grade  and  high  school  in  Marshalltown  and  is 
now  engaged  in  assisting  the  city  of  Keokuk  in  putting  over  a  high-school  building 
program. 

Dr.  Ashbaugh  has  continued  his  work  for  the  Atlantic  school  board,  has  conducted 
an  instructional  survey  at  Forest  City,  and  has  received  several  calls  for  service  with 
county  superintendents.  These  calls  have  been  in  connection  with  the  use  of  stand- 
ardized tests  in  rural  survey  and  supervision. 

Dr.  Ashbaugh  is  state  chairman  of  the  N.  E.  A.  committee  appointed  to  study  rela- 
tive efficiency  of  one  room  rural  schools  and  consolidated  schools.  Other  of  our  mem- 
bers doubtless  hold  the  same  position  for  their  state. 


We  are  glad  to  welcome  two  more  new  members  to  our  association.    They  are: 
Dr.  Bird  T.  Baldwin,  Director  of  the  Child  Welfare  Research  Station,  Iowa  State 

University,  Iowa  City,  la. 

Mr.  H.  D.  Rinsland,  Director  of  Bureau  of  Research  and  Guidance,  Ardmore, 

Oklahoma. 
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STANDARDIZED  VOCABULARY  AND  SENTENCE 

TESTS  IN  FRENCH 

V.  A.  C.  Henmon 

University  of  Wisconsin 

The  ultimate  objectives  of  modern  foreign  language  study  are 
the  ability  to  understand  the  language,  written  or  spoken,  and 
the  ability  to  speak  or  write  the  language.  The  most  obvious 
indices  of  ability  to  understand  a  foreign  language  would  be  found 
in  the  number  of  words  whose  meanings  are  known  or  whose 
equivalents  in  English  can  be  given,  and  in  the  rate  of  accuracy 
of  translating  connected  discourse  from  the  mother  tongue  to  the 
foreign  language.  Ability  or  progress  in  a  foreign  language  may 
then  be  measured  by  determining  (1)  the  scope  and  accuracy  of 
vocabulary,  and  (2)  the  difficulty  of  sentences  that  are  understood 
or  can  be  translated  into  English.  The  present  paper  will  report 
tests  for  measuring  ability  in  French  in  these  two  directions.  The 
method  and  technic  are  the  same  as  used  in  developing  the  Hen- 
mon Vocabulary  and  Sentence  Tests  in  Latin. ^  The  method  of 
scaling  words  or  sentences  in  difficulty  is  given  in  full  in  these 
papers  and  has  been  reported  in  many  other  studies  in  recent 
years  so  often  that  the  statistical  discussion  in  this  report  will  be 
much  abbreviated.  I  am  greatly  indebted  to  my  wife  and  to 
Miss  Alice  Jackson  for  the  laborious  task  of  tabulating  and  scor- 
ing the  papers  and  to  many  principals  and  teachers  of  French  for 
giving  the  preliminary  tests. 

Vocabulary  Tests 

The  essential  difiiculty  in  the  construction  of  vocabulary  tests 

lies  in  the  selection  of  words  to  be  used.     If  results  are  to  be 

strictly  comparable  beyond  the  limits  of  a  single  class  or  of  classes 

using  the  same  text,  they  must  necessarily  be  such  as  the  pupil 

*  Henmon,  V.  A.  C.  "The  measurement  of  ability  in  Latin,"  Journal  of  Educa- 
tional Psychology,  8:515-38,  589-99;  11:121-36,  November-December,  1917;  March, 
1920. 
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has  certainly  come  in  contact  with  and  might  reasonably  be  ex- 
pected to  know.  In  order  to  overcome  this  difficulty  and  to  se- 
cure a  standard  vocabulary  a  tabulation  was  made  of  all  the  words 
occurring  in  twelve  recent  or  widely  used  first-year  texts,  selected 
by  competent  teachers  of  French.  The  result  was  a  list  of  448 
words  out  of  approximately  4,000  words  common  to  all  the  books. 
While  these  448  words  will  occur  with  varying  frequency  in  the 
different  texts,  the  chances  are  slight  that,  if  any  other  book  is 
used  than  one  of  the  twelve  from  which  the  tabulations  were  made, 
these  words  would  not  be  found.  The  list,  therefore,  forms  in  a 
real  sense  a  standard  vocabulary. 

The  448  words  were  divided  into  four  lists  of  112  words  each. 
These  lists  appear  in  Table  II.  They  were  given  to  first-,  second-, 
and  third-year  pupils  in  sixteen  schools  distributed  in  six  states. 
They  were  given  also  to  pupils  who  had  had  one-half,  one  and 
a  half,  and  two  and  a  half  years  of  French,  but  the  number 
of  schools  is  too  small  for  use  in  determining  scale  values. 
Similarly  the  number  of  schools  and  of  pupils  in  the  third  year 
is  too  small  for  satisfactory  use.  Table  I  gives  the  results,  there- 
fore, for  first-  and  second-year  pupils  only,  both  the  averages  and 
medians  being  given  for  the  convenience  of  those  who  may  wish 
to  give  the  original  lists  rather  than  the  tests  derived  from  them. 
The  difference  between  the  two  measures  of  central  tendency  is 
sometimes  fairly  large  where  the  number  of  cases  is  small  or  the 
skewness  of  the  distribution  is  marked.  In  scoring  the  words  in 
the  preliminary  tests  any  translation  given  in  a  standard  diction- 
ary was  accepted.  Where  words  such  as  "lit,"  "la,"  "vers,"  arid 
"montre"  had  several  meanings,  any  one  was  scored  as  correct. 

The  averages  and  medians  in  Table  I  were  obtained  by  scoring 
the  number  of  words  correct  regardless  of  the  variation  in  the 
difficulty  of  the  words.  It  is,  of  course,  inaccurate  to  assign  the 
same  value  to  animal,  which  is  never  missed  by  either  first  or  sec- 
ond-year pupils,  as  to  afin  que,  which  is  missed  by  78  percent  of 
first-year,  and  76.8  percent  of  second-year  pupils.  The  purpose 
of  the  study  was  to  determine  the  weight  or  values  to  be  assigned 
to  each  word  for  each  year  and  a  general  scale  value  or  weight. 
The  information  necessary  for  this  purpose  appears  in  Table  II 
which  gives  the  percent  of  times  each  word  was  correctly 
translated  in  the  first  and  second  years.  These  percents  cannot  be 
used  directly  since  it  is  necessary  to  make  allowance  for  the  fact 
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TABLE  I.   RESULTS  IN  THE  VOCABULARY  TESTS,  ALL  SCHOOLS 

COMBINED 


Lists 

First- Year  Pupils 

Second- Year  Pupils 

No.  of 
Pupils 

Averages 

Medians 

No.  of 
Pupils 

Averages 

Medians 

I 

II 
III 
IV 

415 
517 
440 
482 

82.0 
76.5 
76.8 
74.2 

85 
79 

78 

77 

95 

70 

109 

125 

100.0 
95.3 
94.9 
93.8 

102 
98 
99 
96 

All 

1,854 

77.3 

399 

95.0 

that  the  distribution  of  mental  abilities  is  normal,  or  in  accordance 
with  the  bellshaped  curve  of  distribution,  and  not  rectangular. 
The  method  by  which  this  is  done  consists  in  substance  of  locating 
each  word  on  the  base  line  of  a  normal  surface  of  frequency  in 
terms  of  the  probable  error  equivalents  of  the  percent  of  times  it 
is  correctly  translated.  In  order  to  eliminate  minus  values  an 
approximation  to  a  zero  point  of  ability  was  arbitrarily  taken  by 
locating  the  position  of  a  word  so  easy  as  to  be  missed  by  but  five 
out  of  one  thousand  first-year  pupils.  This  point  lies  3.8  times  the 
probable  error  below  the  median.  A  word  so  difficult  as  to  be 
translated  correctly  by  but  five  out  of  one  thousand  pupils  would 
be  located  at  +3.8  P.  E.  The  scale  values  which  appear  in  Table 
II  were  determined  by  subtracting  from  or  adding  to  3.8  P.  E., 
the  P.  E.  equivalents  of  the  percent  of  times  each  word  was  cor- 
rectly translated. 

The  derivation  of  the  general  scale  value  required  the  deter- 
mination of  the  size  of  the  intervals  between  the  medians  of  the 
first  and  second  years,  and  this  requires  the  amount  and  percent 
of  overlapping  between  the  two  years. 

The  details  of  these  calculations  are  omitted.  It  will  suffice  to 
state  that  the  interval  between  the  first  and  second  years  expressed 
in  terms  of  the  probable  error  as  the  unit  of  measurement  is  2.315 
P.  E.  The  average  position  of  the  zero  point  is  therefore  —2.642 
P.  E.  which  becomes  the  point  of  reference  to  which  each  word  is 
referred.  The  general  scale  values  thus  derived  represent  the 
best  approximation  to  an  average  weight  to  be  assigned  regard- 
less of  year  or  grade. 
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TABLE  n.      TOTAL  LIST  OF  448  WORDS  GIVEN  PUPILS 


Year 

Percents  Correct 

Scale  Values 

General 

Listl 

Scale 
Values 

I 

II 

I 

II 

1.  4 

96.1 

98.9 

1.2 

0.4 

0.8 

2.  Age 

88.7 

100.0 

2.0 

0.0 

1.0 

3.  alors 

81.9 

96.8 

2.4 

1.1 

1.7 

4,  ancien 

94.0 
11.3 

97.9 
18.9 

1.5 
5.6 

0.8 
5.1 

1  1 

5.  appartenir 

5.3 

6.  apr^ 

72.5 

86  3 

2  9 

2.2 

2  5 

7.  arriver 

98.3 
99.0 
90.6 

98.9 
96.8 
96.8 

0.7 
0.3 
1.8 

0.4 
1.1 
1.1 

0  5 

8.  aussi 

0.7 

9.  autre 

1.4 

10,  avoir 

90.1 
97.4 

98.9 
100.0 

1.9 
0.9 

0.4 
0.0 

1.1 

11.  bien 

0.4 

12.  bleu 

95.7 

98.9 

1.3 

0.4 

0.8 

13.  bout 

32.8 

60.0 

4.5 

3.4 

3.9 

14.  caf6 

96.6 

97.9 

1.1 

0.8 

0.9 

IS.  ceci 

62.7 
34.7 

75.8 
83.1 

3.3 
4.4 

2.8 
2.4 

3.0 

16.  cependant 

3.4 

17.  champ 

70.4 

91.5 

3.0 

1.8 

2.4 

18.  chaud 

59.8 

85.2 

3.4 

2.3 

2.8 

19.  cheval 

91.3 

98.9 

1.8 

0.4 

1.1 

20.  chose 

77.1 

97.9 

2.7 

0.8 

1.7 

21.  classe 

97.6 

100.0 

0.9 

0.0 

0.4 

22.  commencer 

98.1 

98.9 

0.7 

0.4 

0.5 

23.  connaltrc 

54.7 

96.8 

3.6 

1.1 

2.3 

24.  c6t6 

51.6 

90.5 

3.7 

1.9 

2.8 

25.  courir 

54.2 
22.4 

91.5 
57.9 

3.6 
4.9 

1.8 
3.5 

2.7 

26.  craindrc 

4.2 

27.  dans 

97.4 

100.0 

0.9 

0.0 

0.4 

28.  d6j4 

68.7 

87.3 

3.1 

2.1 

2.6 

29.  demi 

74.9 

97.9 

2.8 

0.8 

1.8 

30.  descendrc 

95.2 

100.0 

1.3 

0.0 

0.6 

31.  devant 

64.8 

90.5 

3.2 

1.9 

2.5 

32.  diner 

91.1 

91.5 

1.7 

1.8 

1.7 

33.  droit  (adj.) 

59.3 

92.6 

3.5 

1.7 

2.6 

34.  dlfeve 

84.3 

84.2 

2.3 

2.3 

2.3 

35.  encore 

93.5 
43.8 

95.8 
80.0 

1.6 
4.0 

1.3 
2.6 

1.4 

36.  entre 

3.3 

37.  et 

99.0 

100.0 

0.3 

0.0 

0.1 

38.  faire 

92.9 

100.0 

1.6 

0.0 

0.8 
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TABLE  II — CONTINUED 


Year 

Percents  Correct 

Scale  Values 

General 

List  1 — Continued 

Scale 
Values 

I 

II 

I 

n 

39.  fenfitre 

97.2 

97.9 

1.0 

0.8 

0.9 

40.  fils 

73.0 

96.8 

2.9 

1.1 

2.0 

41.  fois 

67.4 

97.9 

3.1 

0.8 

1.9 

42.  franc  (n.) 

86.9 

95.8 

2.1 

1.3 

1.7 

43.  fruit 

93.3 

97.9 

1.6 

0.8 

1.2 

44.  gens 

53.3 

85.2 

3.7 

2.3 

3.0 

45.  guerre 

75.2 

93.7 

2.8 

1.5 

2.1 

46.  heureux 

82.4 

98.9 

2.4 

0.4 

1.4 

47.  homme 

99.0 

100.0 

0.3 

0.0 

0.1 

48.  inviter 

96.1 

100.0 

1.2 

0.0 

0.6 

49.  Jeter 

51.6 

89.4 

3.7 

1.9 

2.8 

50.  journal 

89.2 

95.8 

2.0 

1.3 

1.6 

51.  laisser 

60.0 

83.1 

3.4 

2.4 

2.9 

52.  le 

95.9 

100.0 

1.2 

0.0 

0.6 

53.  leur 

89.2 

97.9 

2.0 

0.8 

1.4 

54.  lire 

51.6 
18.9 
90.3 
99.2 
93.5 

96.8 
61.1 
98.9 
100.0 
97.9 

3.7 
5.1 
1.9 
0.2 
1.6 

1.1 
3.4 
0.4 
0.0 
0.8 

2.4 

55.  loin 

4.2 

56.  madame 

1.1 

57.  mais 

0.1 

58.  manger 

1.2 

59.  me 

88.7 
65.3 
55.9 
56.1 
88.2 
68.7 
58.8 
70.8 
82.9 
81.7 
88.2 
33.1 
63.9 
73.3 
12.0 

91.5 
83.1 
84.2 
87.4 
97.9 
66.3 
90.5 
89.4 
94.7 
97.9 
100.0 
68.4 
64.2 
91.5 
70.5 

2.0 
3.2 
3.6 
3.6 
2.0 
3.1 
3.5 
3.0 
2.4 
2.5 
2.0 
4.4 
3.3 
3.0 
5.5 

1.8 
2.4 
2.3 
2.1 
0.8 
3.2 
1.9 
1.9 
1.4 
0.8 
0.0 
3.1 
3.3 
1.8 
3.0 

1.9 

60.  mer 

2.8 

61.  mieux 

2.9 

62.  moins 

2  8 

63.  monde 

1.4 

64.  montrer 

3.1 

65.  mourir 

2.7 

66.  ni 

2.4 

67.  n6tre  (pron.) 

1.9 

68.  nuit 

1.6 

69.  offrir ". 

1.0 

70.  Oreille 

3.7 

71.  ou 

3.3 

72.  ouvrir 

2.4 

73.  paraltre 

4.2 

74.  partie 

48.7 

74.7 

3.8 

2.8 

3.3 

75.  passer 

92.7 

96.8 

1.6 

1.1 

1.3 
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TABLE  II — CONTINUED 


List  1 — Continued 


76.  pendant. . . 

77.  permettre. . 

78.  peu 

79.  plein 

80.  plusieurs. . . 

81.  porter 

82.  pouvoir 

83.  presque 

84.  promener. . 

85.  quatre 

86.  que  (pron.) 

87.  qui 

88.  quoique. . . 

89.  rentrer. . . . 

90.  rendre 

91.  robe 

92.  sans 

93.  second 

94.  sept 

95.  si 

96.  soleil 

97.  sou 

98.  souvent. . . 

99.  suivre 

100.  tant 

101.  temps 

102.  tomber 

103.  tout  (adv.) . 

104.  tres 

105.  trouver 

106.  vache 

107.  vent 

108.  viande 

109.  vingt 

110.  vivre 

HI.  voiture. . . . 
112.  vous 


Percents  Correct 


48.9 
69.1 
85.5 
35.9 
53.3 
82.9 
58.3 
35.2 
70.6 
96.8 
89.4 
92.8 
14.9 
47.9 
60.2 
93.0 


79, 
89, 
93, 
92, 


5 
9 
5 
3 

88.9 
62.4 
53.1 
24.8 


26. 
94. 

77. 
91. 
96. 


.3 
.2 

.7 
.3 
.1 
88.5 
80.9 
62.4 
75.2 
88.7 
74.7 
22.3 
97.2 


II 


83.1 
94.7 
98.9 
80.0 
73.7 
94.7 
91.5 
76.8 
90.5 
97.9 
90.5 
97.9 
25.3 
62.1 
70.5 
97.9 
96.8 
97.9 
98.9 
98.9 
95.8 
76.8 
82.1 
87.4 
68.4 
95.8 
97.9 
85.2 
98.9 
100.0 
82.1 
78.9 
86.3 
94.7 
93.7 
93.7 
95.8 


Year 
Scale  Values 


3.8 
3.1 
2.2 


3.0 
1.1 
1.9 
1.6 
5.3 
3.9 
3.4 


1.7 
2.0 
3.3 
3.7 
4.8 
4.7 
1.5 
2.7 
1.8 
1.2 
2.0 
2.6 
3.3 
2.8 
2.0 
2.8 
4.9 
1.0 


II 


2.4 
1.4 
0.4 
2.6 
2.9 
1.4 
1.8 
2.7 
1.9 
0.8 
1.9 
0.8 
4.8 
3.3 
3.0 
0.8 
1.1 
0.8 
0.4 
0.4 
1.3 
2.7 
2.4 
2.1 
3.1 
1.3 
0.8 
2.3 
0.4 
0.0 
2.4 
•2.6 
2.2 
1.4 
1.5 
1.5 
1.3 
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TABLE  II — CONTINUED 


list  2 

Percents  Correct 

Year 
Scales  Values 

General 
Scale 
Values 

I 

II 

I 

n 

1.  acheter 

2.  aimer 

95.0 
98.3 
98.3 
100.0 
79.3 
97.9 
59.6 
28.0 
83.6 
98.6 
49.9 
43.7 
55.5 
88.6 
72.1 
36.3 
91.3 
54.9 
53.6 
58.0 
72.5 
64.4 
93.0 
61.1 
23.8 
81.8 
94.8 
32.3 
29.2 
99.6 
20.3 
36.9 
83.4 
98.6 
96.3 
96.5 
91.7 
21.3 

97.1 

100.0 

100.0 

100.0 

100.0 

97.1 

80.0 

37.1 

92.9 

100.0 

52.9 

74.3 

91.4 

91.4 

87.1 

88.6 

97.1 

91.4 

47.1 

92.9 

100.0 

94.3 

100.0 

91.4 

45.7 

95.7 

98.6 

45.7 

77.1 

100.0 

47.1 

55.7 

97.1 

100.0 

100.0 

98.6 

98.6 

52.9 

1.4 
0.7 
0.7 
0.0 
2.6 
0.8 
3.4 
4.7 
2.4 
0.5 
3.8 
4.0 
3.6 
2.0 
2.9 
4.3 
1.8 
3.6 
3.7 
3.5 
2.9 
3.3 
1.6 
3.4 
4.9 
2.5 
1.4 
4.5 
4.6 
0.0 
5.0 
4.3 
2.4 
0.5 
1.2 
1.1 
1.7 
5.0 

1.0 
0.0 
0.0 
0.0 
0.0 
1.0 
2.6 
4.3 
1.6 
0.0 
3.7 
2.8 
1.8 
1.8 
2.1 
2.0 
1.0 
1.8 
3.9 
1.6 
0.0 
1.5 
0.0 
1.8 
4.0 
1.3 
0.5 
4.0 
2.7 
0.0 
3.9 
3.6 
1.0 
0.0 
0.0 
0.5 
0.5 
3.7 

1.2 
0.3 

3.  ami 

0.3 

4.  animal 

5.  appeler 

6.  arbre 

7.  assez 

0.0 
1.3 
0.9 
3.0 

8.  aussit6t 

4.5 

9.  avancer. 

2.0 

10.  beau 

0.2 

11.  bientdt 

3.7 

12.  boire 

3.4 

13.  bras 

2.7 

14.  campagne 

1.9 

15.  cela 

2.5 

16.  chacun 

3.1 

17.  chanter 

1.4 

18.  chemin 

2.7 

19.  chez 

3.8 

20.  ciel 

2.5 

21.  coeur 

1.4 

22.  comment 

2.4 

23.  content 

0.8 

24.  coucher 

2.6 

25.  court 

4.4 

26.  crier 

1.9 

27.  de 

0.9 

28.  dejeuner  (n.) 

29.  depuis 

4.2 
3.6 

30.  d^sirer 

0.0 

31.  devenir 

4.4 

32.  dont 

3.8 

33.  eau 

1.7 

34.  elle 

0.2 

35.  enfant 

0.6 

36.  entrer 

0.8 

37.  6tre 

1.1 

38.  falloir 

4.3 
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TABLE  II — CONTINUED 


List  2 — Continued 


39.  fer 

40.  fin  (n.) . . . . 

41.  fort 

42.  frapper 

43.  gagner 

44.  grammaire. 

45.  habit 

46.  hicr 

47.  huit 

48.  jamais 

49.  jeune 

50.  journ6e 

51.  kit 

52.  lecon 

53.  lever 

54.  Ut 

55.  long 

56.  magasin . . . 

57.  maison . . . . 

58.  marcher . . . 

59.  meilleur. . . 

60.  mfere 

61.  mille 

62.  moindre. . . 

63.  monsieur. . 

64.  morceau . . . 

65.  ne 

6 1   noir 

67.  notre  (adj.) 

68.  nul 

69.  on 

70.  ordonner... 

71.  oublier. . . . 

72.  pain 

73.  parce  que . . 

74.  partir 

75.  pauvre. . . . 


Percents  Correct 


42.9 
47.0 
74.7 
77.0 
35.2 
97.7 
42.9 
74.3 
75.6 
82.4 
91.5 
22.1 
68.3 
94.2 
59.8 
38.3 
87.0 
84.9 
99.4 
88.4 
69.6 
98.8 
71.8 
25.5 
98.1 
77.2 
76.6 
76.0 
78.9 
26.3 
67.1 
44.9 
43.5 
91.5 
77.8 
66.1 
93.2 


II 


67.1 
85.7 
94.3 
95.7 
85.7 
97.1 
67.1 
91.4 
97.1 
100.0 
97.1 
65.7 
88.6 


97. 
97. 
85. 
98. 
92. 
97. 

100.0 
91.4 

100.0 
95.7 
37.1 

100.0 
91.4 
87.1 
85.7 
91.4 
31.4 
82.9 
68.6 
90.0 
98.6 
98.6 
95.7 

100.0 


Year 
Scale  Values 


4.1 
3.9 
2.8 
2.7 
4.4 
0.8 
4.1 
2.8 
2.8 
2.4 
1.8 
4.9 
3.1 
1.5 
3.4 
4.2 
2.1 
2.3 
0.1 
2.0 
3.0 
0.4 
2.9 
4.8 
0.7 
2.7 
2.7 
2.8 
2.6 
4.7 
3.1 
4.0 
4.0 
1.8 
2.7 
3.2 
1.6 


II 


3.1 
2.2 
1.5 
1.3 
2.2 
1.0 
3.1 
1.8 
1.0 
0.0 
1.0 
3.2 
2.0 
1.0 
1.0 
2.2 
0.5 
1.6 
1.0 
0.0 
1.8 
0.0 
1.3 
4.3 
0.0 
1.8 
2.1 
2.2 
1.8 
4.5 
2.4 
3.1 
1.9 
0.5 
0.5 
1.3 
0.0 


General 
Scale 
Values 


3.6 
3.0 
2.1 
2.0 
3.3 
0.9 


4.0 
2.5 
1.2 
2.2 
3.2 
1.3 
1.9 
0.5 
1.0 
2.4 
0.2 
2.1 
4.5 
0.3 
2.2 
2.4 
2.5 
2.2 
4.6 
2.7 
3.5 
2.9 
1.1 
1.6 
2.2 
0.8 
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TABLE  II — CONTINUED 


List  2 — Continued 


76.  penser 

77.  personne  (n.) 

78.  peur 

79.  pleurer 

80.  point  (adv.). 

81.  pour 

82.  premier 

83.  prfet 

84.  puis 

85.  que  (conj.) . . 

86.  quinze 

87.  recevoir 

88.  remarquer . . 

89.  rdpondre 

90.  riche 

91.  rouge 

92.  sauver 

93.  semaine. . . . 

94.  servir 

95.  six 

96.  soir 

97.  Soulier 

98.  Sucre 

99.  sur 

100.  tante 

101.  tenir 

102.  ton 

103.  tout  (adj.) . . 

104.  trois 

105.  tu 

106.  valoir 

107.  verre 

108.  vie 

109.  vieux 

110.  void 

111.  voix 

112.  voyage 


Percents  Correct 


80.7 
57.5 
27.0 
32.7 
10.6 
89.4 
95.6 
41.0 
51.8 
76.4 
75.8 
89.8 
88.4 
92.6 
98.3 


97. 
38. 
68. 
77. 
97. 
68.5 
26.7 
71.0 
90.9 
61.7 
50.3 
45.3 
94.6 
96.1 
82.8 
9.0 
36.6 
65.6 
72.5 
68.9 
57.8 
96.7 


II 


100.0 
52.9 
80.0 
70.0 
34.3 
91.4 
98.6 
62.9 
70.0 
88.6 
87.1 
98.6 
91.4 

100.0 

100.0 
98.6 
62.9 
92.9 
97.1 

100.0 
92.9 
62.9 
88.6 
80.0 
82.9 
85. 
81. 
95. 
98. 
95. 
20. 
67.1 
92.9 
95.7 
78.6 
88.6 
98.6 


Year 
Scales  Values 


2.5 
3.5 
4.7 
4.5 
5.7 
1.9 
1.3 
4.1 
3.8 
2.7 
2.8 
1.9 
2.0 
1.7 
0.7 
0.8 
4.2 
3.1 
3.7 
0.9 
3.1 
4.7 
3.0 
1.8 
3.4 
3.8 
4.0 
1.4 
1.2 
2.4 
5.8 
4.3 
3.2 
2.9 
3.1 
3.5 
1.1 


II 


0.0 
3.7 
2.6 
3.0 
4.4 
1.8 
0.5 
3.3 
3.0 
2.0 
2.1 
0.5 
1.8 
0.0 
0.0 
0.5 
3.3 
1.6 
1.0 
0.0 
1.6 
3.3 
2.0 
2.6 


3.1 
1.6 
1.3 
2.6 
2.0 
0.5 


General 
Scale 
Values 


1.2 
3.6 
3.6 

3.7 


0.3 
0.6 


1.8 
5.4 
3.7 
2.4 
2.1 
2.8 
2.7 
0.8 
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Lists 

Percents  Correct 

Year 
Scale  Values 

General 
Scale 
Values 

I 

II 

I 

II 

1.  affaire 

88.6 
43.0 
98.4 
83.2 
81.6 
95.7 
55.0 
19.5 
62.1 
93.6 
54.1 
67.9 
53.4 
55.9 
48.2 
93.6 
93.4 
92.9 
88.2 
57.5 
83.4 
77.0 
96.6 
25.4 
37.5 
22.9 
95.5 
67.0 
47.9 
98.2 
67.4 
59.3 
97.0 
37.7 
46.9 
39.1 
94.3 
88.2 

90.8 
66.1 
94.7 
84.4 
85.3 
99.1 
84.4 
30.3 
89.9 
95.4 
92.7 
95.4 
80.7 
83.5 
45.9 
99.1 
98.2 
99.1 
94.2 
77.1 
85.3 
94.5 
99.1 
61.5 
45.9 
85.3 
100.0 
93.6 
91.6 
99.1 
68.8 
94.5 
95.4 
43.1 
83.5 
75.2 
99.1 
95.4 

2.0 
4.1 
0.6 
2.4 
2.5 
1.3 
3.6 
5.1 
3.3 
1.5 
3.6 
3.1 
3.7 
3.6 
3.9 
1.5 
1.6 
1.6 
2.0 
3.5 
2.4 
2.7 
1.1 
4.8 
4.3 
4.9 
1.3 
3.1 
3.9 
0.7 
3.1 
3.5 
1.0 
4.3 
3.9 
4.2 
1.5 
2.0 

1.8 
3.2 
1.4 
2.3 
2.3 
0.3 
2.3 
4.6 
1.9 
1.3 
1.6 
1.3 
2.5 
2.4 
4.0 
0.3 
0.7 
0.3 
1.5 
2.7 
2.3 
1.4 
0.3 
3.4 
4.0 
2.3 
0.0 
1.5 
1.8 
0.3 
3.1 
1.4 
1.3 
4.1 
2.4 
2.8 
0.3 
1.3 

1.9 

2.  ainsi 

3.6 

3.  amuser 

1.0 

4.  ann6e 

2.3 

5.  apporter 

2.4 

6.  argent 

0.8 

7.  attendre 

2.9 

8.  autant 

4.8 

9.  avant 

2.6 

10.  beaucoup 

1.4 

11.  billet 

2.6 

12.  bois 

2.2 

13.  bruit 

3.1 

14.  car 

3.0 

15.  celui 

3.9 

16.  chambre 

0.9 

17.  chapeau 

1.1 

18.  cher 

0.9 

19.  chien  

1.7 

20.  cincjuante. 

3.1 

21.  combien 

2.3 

22.  comprendre 

2.0 

23.  continuer 

0.7 

24.  coup 

4.1 

25.  couteau 

4.1 

26.  croire 

3.6 

27.  d6cider 

0.6 

28.  demain 

29.  dernier 

30.  deux 

31.  devoir 

32.  dormir 

33.  6cole 

2.3 
2.8 
0.5 
3.1 
2.4 
1.1 

34.  en  (adv.) 

4.2 

35.  enfin 

3.1 

36.  envoyer 

37.  dtudier 

3.5 
0.9 

38.  famille 

1.6 
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TABLE  II — 

CONTINUED 

lost  3 — Continued 

Percents  Correct 

Year 
Scale  Values 

General 

Scale 

Values 

I 

II 

I 

n 

39.  feu 

52.7 
94.8 
28.9 
95.7 
98.8 
97.8 
70.0 
86.6 
95.9 
98.4 
80.0 
81.6 
86.6 
54.5 
6.8 
95.2 
31.8 
85.9 
47.3 
95.0 
80.9 
36.8 
13.6 
53.5 
81.1 
80.0 
82.4 
86.1 
91.1 
72.7 
81.8 
51.4 
97.0 
99.0 
98.6 
82.0 
86.4 

90.8 
97.2 
71.6 
99.1 
100.0 
100.0 
91.7 
91.7 
96.3 
96.3 
88.1 
81.6 
92.7 
74.3 
32.1 
98.2 
54.1 
100.0 
84.4 
99.1 
93.5 
87.2 
45.0 
86.2 
62.4 
89.9 
89.0 
98.2 
94.5 
91.7 
93.5 
47.7 
98.2 
100.0 
100.0 
93.6 
95.4 

3.7 
1.4 
4.6 
1.3 
0.4 
0.9 
3.0 
2.2 
1.2 
0.6 
2.6 
2.5 
2.2 
3.6 
6.0 
1.3 
4.5 
2.2 
3.9 
1.4 
2.5 
4.3 
5.4 
3.7 
2.5 
2.6 
2.4 
2.2 
1.8 
2.9 
2.5 
3.7 
1.0 
0.3 
0.5 
2.4 
2.2 

1.8 
1.0 
3.0 
0.3 
0.0 
0.0 
1.7 
1.7 
1.2 
1.2 
2.1 
2.5 
1.6 
2.8 
4.5 
0.7 
3.6 
0.0 
2.3 
0.3 
1.6 
2.1 
4.0 
2.2 
3.3 
1.9 
2.0 
0.7 
1.4 
1.7 
1.6 
3.9 
0.7 
0.0 
0.0 
1.5 
1.3 

2.7 

40.  finir 

1.2 

41.  fou,  fol 

3.8 

42.  frSre 

0.8 

43.  garfon 

0.2 

44.  grand 

0.4 

45.  haut 

2.3 

46.  hiver 

1.9 

47.  ici 

1.2 

48.  jardin 

0.9 

49.  jouer 

2.3 

50.  la    

2.5 

51.  langue 

1.9 

52.  lequel 

3.2 

53.  lieu 

5.2 

54.  livre 

1.0 

55.  lorsque 

4.0 

56.  main 

1.1 

57.  maltre 

3.1 

58.  matin 

0.8 

59.  mSme 

2.0 

60.  mettre 

3.2 

61.  minuit 

4.7 

62.  mois 

2.9 

63.  monter 

2.9 

64.  mort 

2.2 

65.  neige 

2.2 

66.  nom 

1.4 

67.  nous 

1.6 

68.  ob6ir 

2.3 

69.  onze 

2.0 

70.  ordre 

3.8 

71.  oui 

0.8 

72.  papier 

0.1 

73.  parler 

0.2 

74.  pas  (adv.) 

1.9 

75.  paver 

1.7 
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List  3 — Continued 


76.  pfere 

77.  personne  (pron.) 

78.  pied 

79.  plume 

80.  point  (n.) 

81.  pourquoi 

82.  prendre 

83.  prin temps 

84.  quand 

85.  quelque 

86.  quitter 

87.  regarder 

88.  remercier 

89.  rester 

90.  rien 

91.  rue 

92.  savoir 

93.  sembler 

94.  seul 

95.  soie 

96.  sortir 

97.  sourire 

98.  sufl&re 

99.  surtout 

100.  tard 

101.  tfete 

102.  toujours 

103.  traduire 

104.  troisiSme 

105.  un 

106.  vendre 

107.  vers 

108.  ville 

109.  visite 

110.  voila 

111.  votre 

112.  vrai 


Percents  Correct 


99.0 
48.2 
74.1 
95.0 
47.5 
92.5 
47.3 
66.8 
95.5 
61.1 
57.0 
92.9 
71.1 
52.9 
68.2 
87.0 
57.9 
40.9 
61.8 
40.9 
53.9 
10.4 
9.8 
19.7 
83.4 
75.4 
81.6 
30.7 
58.2 
98.0 
75.2 
41.1 
87.0 
79.1 
69.5 
89.1 
70.9 


II 


98.2 
71.6 
85.3 
100.0 
68.8 
96.3 
90.8 
72.5 
99.1 
67.9 
86.2 
99.1 
89.9 
82.6 
89.9 
94.5 
94.5 
85.3 
97.2 
56.0 
85.3 
50.5 
10.2 
69.7 
94.5 
98.2 
94.5 
68.8 
81.7 
96.3 
86.2 
79.8 
90.8 
92.7 
76.1 
94.5 
93.5 


Year 
Scale  Values 


0.3 
3.9 
2.8 
1.4 
3.9 
1.7 
3.9 
3.2 
1.3 
3.4 
3.0 
1.6 
3.0 
3.7 
3.1 
2.1 
3.5 
4.1 
3.4 
4.1 
3.7 
5.7 
5.7 
5.1 
2.4 
2.8 
2.5 
4.5 
3.5 
0.8 
2.8 
4.1 
2.1 
2.6 
3.0 
2.0 
3.0 


II 


0.7 
3.0 
2.3 
0.0 
3.1 
1.2 
1.8 
2.9 
0.3 
3.1 
2.2 
0.3 
1.9 
2.4 
1.9 
1.4 
1.4 
2.3 
1.0 
3.6 
2.3 
3.8 
5.7 
3.0 
1.4 
0.7 
1.4 
3.1 
2.5 
1.2 
2.2 
2.6 
1.8 
1.6 
2.8 
1.4 
1.6 


General 
Scale 
Values 


0.5 
3.4 
2.5 
0.7 
3.5 
1.4 
2.8 
3.0 
0.8 
3.2 
2.6 
0.9 
2.4 
3.0 
2.5 
1.7 
2.4 
3.2 
2.2 
3.8 
3.0 
4.7 
5.7 
4.0 
1.9 
1.7 
1.9 
3.8 
3.0 
1.0 
2.5 


1.7 
2.3 
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TABLE  II — CONTINUED 


List  4 


1.  afin  que. . . 

2.  aUer 

3.  an 

4.  apercevoir. 

5.  apprendre. . 

6.  arrfiter. . . . 

7.  aujourd'hui , 

8.  autour 

9.  avec 

10.  besoin 

11.  blanc 

12.  bon 

13.  ca 

14.  ce 

15.  cent 

16.  chaise 

17.  chaque. . . . 

18.  chercher . . . 

19.  choisir 

20.  clair 

21.  comme. . . . 

22.  conduire. . . 

23.  corps 

24.  couper 

25.  couvrir. . . . 

26.  dame 

27.  d6fendre... 

28.  demander. . 

29.  derriere. . . . 

30.  deuxiSme . . 

31.  difficile. . . . 

32.  doux .  r . . . . 

33.  dcrire 

34.  en  (prep.) . . 

35.  entendre. . . 

36.  esp6rer .... 

37.  faim 

38.  femme 


Percents  Correct 


22.0 
98.8 
52.9 
74.7 
29.0 
64.9 
92.9 
36.5 
98.4 
51.0 
96.7 
98.0 
41.7 
90.9 
81.5 
72.4 
53.7 
76.1 
84.4 
71.8 
74.7 
46.3 
72.4 
45.7 
48.9 
92.9 
92.1 
98.0 
58.3 
68.3 
94.6 
36.1 
80.5 
56.6 
59.5 
56.8 
50.2 
92.1 


II 


23.2 
100.0 
70.4 
92.0 
52.8 
93.6 
98.4 
78.4 
100.0 
78.4 
100.0 
97.6 
76.8 
96.8 
97.6 
92.0 
90.4 
95.2 
97.6 
96.8 
95.2 
83.6 
93.6 
79.2 
88.8 
95.2 
97.6 
99.2 
76.0 
84.4 
97.6 
72.8 
99.2 
85.6 
84.8 
92.0 
62.0 
97.6 


Year 
Scale  Values 


4.9 
0.4 
3.7 
2.8 
4.6 


1.1 
0.8 
4.1 
1.8 
2.5 
2.9 
3.7 
2.8 
2.3 
2.9 
2.8 
3.9 
2.9 
4.0 
3.8 
1.6 
1.7 
0.8 
3.5 
3.1 
1.4 
4.3 
2.5 
3.6 
3.4 
3.5 
3.8 
1.7 


II 


4.9 
0.0 
3.0 
1.7 
3.7 
1.5 
0.6 
2.6 
0.0 
2.6 
0.0 
0.9 
2.7 
1.1 
0.9 
1.7 
1.9 
1.3 
0.9 
1.1 
1.3 
2.4 
1.5 
2.6 
2.0 
1.3 
0.9 
0.2 
2.8 
2.3 
0.9 
2.9 
0.2 


General 
Scale 
Values 


4.9 
0.2 
3.3 
2.2 
4.1 
2.3 
1.1 
3.4 
0.3 
3.2 
0.5 
0.8 
3.4 
1.4 
1.7 
2.3 
2.8 
2.0 
1.6 
2.0 
2.0 
3.1 
2.2 
3.3 
2.9 
1.4 
1.3 
0.5 
3.1 


2.9 
2.8 
2.6 

3.5 
1.3 
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TABLE  II — CONTINUED 


List  4 — Continued 

Percents  Correct 

Year 
Scale  Values 

General 
Scale 
Values 

I 

II 

I 

II 

39.  fille 

99.0 
88.4 
37.1 
87.8 
59.5 
88.0 
90.3 
98.6 
97.8 
98.8 
96.3 
90.0 
73.4 
96.3 
42.7 
12.7 
90.0 
95.9 
64.3 
79.4 
21.4 
60.8 
88.8 
88.0 
46.3 
64.9 
87.6 
92.9 
82.8 
61.6 
46.3 
85.9 
58.5 
63.9 
24.9 
16.6 
67.4 

100.0 
95.2 
72.0 

100.0 
82.0 
96.0 
98.4 
98.4 
98.4 
98.4 
98.4 
92.2 
76.0 

100.0 
87.2 
38.4 
96.0 
99.2 
86.4 
79.2 
46.4 
86.4 
92.0 
89.4 
59.2 
98.4 
95.2 
97.6 
96.8 
88.8 
73.6 
88.0 
88.0 
91.4 
62.0 
59.2 
96.8 

0.3 
2.0 
4.3 
2.1 
3.4 
2.1 
1.9 
0.5 
0.8 
0.4 
1.2 
1.9 
2.9 
1.2 
4.1 
5.5 
1.9 
1.2 
3.3 
2.6 
5.0 
3.4 
2.0 
2.1 
3.9 
3.2 
2.1 
1.6 
2.4 
3.4 
3.9 
2.2 
3.3 
3.3 
4.8 
5.2 
3.1 

0.0 
1.3 
2.9 
0.0 
2.4 
1.2 
0.6 
0.6 
0.6 
0.6 
0.6 
1.7 
2.8 
0.0 
2.1 
4.2 
1.2 
0.2 
2.2 
2.6 
3.9 
2.2 
1.7 
1.9 
3.5 
0.6 
1.3 
0.9 
1.1 
2.0 
2.9 
2.1 
2.1 
1.8 
3.3 
3.5 
1.1 

0.1 

40.  fleur 

1.6 

41.  frais 

3.6 

42.  froid 

1.0 

43.  gauche 

2.9 

44.  gros 

1.6 

45.  heure 

1.2 

46,  histoire 

0.5 

47.  il 

0.7 

48.  ie 

0.5 

49.  jour 

0.9 

50.  14 

1.8 

51.  le  (pron.) 

2.8 

52.  lettre 

0.6 

53.  ligne 

3.1 

54.  loi 

4.8 

55.  lui 

1.5 

56.  maintenant 

0.7 

57.  mal  (adv.) 

2.8 

58.  mauvais 

2.6 

59.  mener 

4.4 

60.  midi 

61.  moi 

2.8 
1.8 

62.  men 

2.0 

63.  montre 

3.7 

64.  mot 

1.9 

65.  neuf  (no.) 

1.7 

66.  non 

1.2 

67.  nouveau 

1.7 

68.  ceil 

2.7 

69.  or 

3.4  . 

70.  oil 

2.1 

71.  ouvert 

72.  par 

2.7 
2.5 

73.  panni 

74.  pas  (n) 

75.  Davs 

2.0 
4.3 
2.1 
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TABLE  II — CONTINUED 


List  4 — Continued 


76.  perdre 

77.  petit  (adj.).... 

78.  plaire 

79.  plus 

80.  porte 

81.  pourvu  que. . . 

82.  pr&sde 

83.  professeur. . . . 

84.  quart 

85.  question 

86.  quo! 

87.  rSgle 

88.  remplir 

89.  r^ussir 

90.  rire 

91.  saUe 

92.  se 

93.  sentir 

94.  seulement 

95.  soil 

96.  son  (poss.  adj.) 

97.  sous 

98.  suite 

99.  table 

100.  te 

101.  toi 

102.  tort 

103.  travail .• . . 

104.  trop 

105.  utile 

106.  venir... .-. 

107.  vert 

108.  vin 

109.  vite 

110.  voir 

HI.  vouloir 

112.  y 


Percents  Correct 


55 
99 
35 
90 
75 
7 
66 
96 
52, 
98, 
57, 
36 
37, 
21, 
47, 
84, 
45, 
14 
54, 
19 
91 
53, 
23, 
98. 
56, 
51, 
15, 
67, 
59, 
57, 
73. 
71. 
64. 
51. 
83. 
71. 
77. 


II 


84.4 
99.2 
80.0 
96.0 
85.6 
20.0 
87.2 
98.4 
68.0 
98.4 
83.6 
66.0 
67.2 
39.2 
88.0 
92.2 
55.2 
64.0 
79.2 
34.4 
96.8 
83.2 
32.0 
98.4 
73.6 
66.0 
50.4 
91.2 
76.0 
72.0 
96.8 
93.6 
95.2 
83.2 
99.2 
93.6 
86.4 


Year 
Scale  Values 


3.6 
0.0 
4.4 
1.8 
2.8 
5.9 
3.2 
1.1 
3.7 
0.5 
3.5 
4.3 
4.3 
5.0 
3.9 
2.3 
4.0 
5.4 
3.6 
5.1 
1.8 
3.7 
4.9 
0.4 
3.6 
3.7 
5.3 
3.1 
3.5 
3.5 
2.9 
3.0 
3.2 
3.7 
2.4 
3.0 
2.7 


n 


2.3 
0.2 
2.6 
1.2 
2.2 
5.0 
2.1 
0.6 
3.1 
0.6 
2.4 
3.2 
3.1 
4.2 
2.1 
1.7 
3.6 
3.3 
2.6 
4.4 
1.1 
2.4 
4.5 
0.6 
2.9 
3.2 
3.8 
1.8 
2.8 
2.9 
1.1 
1.5 
1.3 
2.4 
0.2 
1.5 
2.2 


General 
Scale 
Values 


2.9 

0.1 

3.5 

1.5 

2.5 

5.4 

2.6 

0.8 

3.4 

0.5 

2.9 

3.7 

3.7 

4.6 

3.0 

2.0- 

3.8 

4.3 

3.1 

4.7 

1.4 

3.0 

4.7 

0.5 

3.2 

3.4 

4.5 

2.4 

3.1 

3.2 

2.0 

2.2 

2.2 

3.0 

1.3 

2.2 

2.4 
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From  the  total  list  of  448  words  a  selection  was  made  by  elim- 
inating all  those  words  which  were  never  missed  by  either  first-  or 
second-year  pupils,  those  whose  meanings  are  readily  inferred 
from  the  English  correspondents,  those  which  showed  inversions, 
being  translated  correctly  more  often  by  first-year  pupils  than  by 
second-year  pupils,  and  those  words  which  experience  had  shown 
were  troublesome  for  one  reason  or  another  to  score.  This  re- 
duced the  list  to  240  words  which  were  grouped  into  four  sixty- 
word  standard  vocabulary  tests  of  equal  diflSculty.  These  tests 
with  the  weights  to  be  given  each  word  and  the  sum  of  the  scale 
values  are  as  follows: 


FRENCH  VOCABULARY  TESTS* 

A 

B 

C 

D 

aujourd'hui 

1.1 

acheter 

1.2 

soleil 

1.6 

autre 

1.4 

chose 

1.7 

chien 

1.7 

alors 

1.7 

choisir 

1.6 

nouveau 

1.7 

rue 

1.7 

t^te 

1.7 

vingt 

1.7 

porter 

1.9 

tard 

1.9 

crier 

1.9 

sans 

1.8 

hiver 

1.9 

toujours 

1.9 

parmi 

2.0 

chcrcher 

2.0 

onze 

2.0 

salle 

2.0 

frapper 

2.0 

compren- 
dre 

2.0 

venir 

2.0 

mfeme 

2.0 

pays 

2.1 

fort 

2.1 

vieux 

2.1 

vivre 

2.1 

apercevoir 

2.2 

guerre 

2.1 

mille 

2.1 

oH 

2.1 

partir 

2.2 

morceau 

2.2 

vert 

2.2 

permettre 

2.2 

neige 

2.2 

mort 

2.2 

vouloir 

2.2 

bois 

2.2 

arrfeter 

2.3 

vin 

2.2 

ann6e 

2.3 

hier 

2.3 

ob6ir 

2.3 

lever 

2.2 

haut 

2.3 

soir 

2.3 

demain 

2.3 

jouer 

2.3 

semaine 

2.3 

connattre 

2.3 

comment 

2.4 

combien 

2.3 

meilleur 

2.4 

ouvrir 

2.4 

ni 

2.4 

promener 

2.4 

apporter 

2.4 

travail 

2.4 

savoir 

2.4 

quinze 

2.4 

dormir 

2.4 

cela 

2.5 

champ 

2.4 

remercier 

2.4 

vie 

2.4 

noir 

2.5 

ciel 

2.5 

ne 

2.4 

lire 

2.4 

Sucre 

2.5 

rien 

2.5 

apr^s 

2.5 

devant 

2.5 

vcndre 

2.5 

viande 

2.5 

pied 

2.5 

kit 

2.5 

coucher 

2.6 

biUet 

2.5 

par 

2.5 

vache 

2.5 

droit 

2.6 

mauvais 

2.6 

porte 

2.5 

dijk 

2.6 

prSs  de 

2.6 

pouvoir 

2.6 

avant 

2.6 

quitter 

2.6 

chemin 

2.7 

deuxiSme 

2.7 

esp6rer 

2.6 

bras 

2.7 

ceil 

2.7 

mourir 

2.7 

feu 

2.7 

on 

2.7 

voix 

2.7 

courir 

2.7 

chaque 

2.8 

ouvert 

2.7 

entendre 

2.8 

c6t6 

2.8 

chaud 

2.8 

Jeter 

2.8 

mer 

2.8 

midi 

2.8 

moins 

2.8 

1  These  tests  can  be  procured  from  the  writer,  University  of  Wisconsin.  Madison,  Wisconsin. 
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FRENCH  VOCABULARY  TESTS — CONTINUED 


A 

B 

C 

D 

mois 

2.9 

dernier 

2.8 

voici 

2.8 

couvrir 

2.9 

oublier 

2.9 

perdre 

2.9 

quoi 

2.9 

tante  ; 

2.9 

gauche 

2.9 

attendre 

2.9 

vent 

2.9 

voil4  "J 

2.9 

mieux 

2.9 

laisser 

2.9 

assez 

3.0 

ceci    i 

3.0 

rester 

3.0 

printemps 

3.0 

car 

3.0 

fin  ^ 

3.0 

rire 

3.0 

sortir 

3.0 

gens 

3.0 

souvent 

3.0 

chacun 

3.1 

vite 

3.0 

sous 

3.0 

troisiSme 

3.0 

seulement 

3.1 

bruit 

3.1 

tenir 

3.0 

devoir 

3.0 

conduire 

3.1 

pendant 

3.1 

enfin 

3.1 

cinquante 

3.1 

quelque 

3.2 

trop 

3.1 

maltre 

3.1 

ligne 

3.1 

rendre 

3.2 

mettre 

3.2 

derriere 

3.1 

besoin 

3.2 

sembler 

3.2 

ton 

3.2 

Ut 

3.2 

lequel 

3.2 

gagner 

3.3 

entre 

3.3 

utile 

3.2 

voiture 

3.2 

ou 

3.3 

partie 

3.3 

couper 

3.3 

an 

3.3 

cependant 

3.4 

ca 

3.4 

plusieurs 

3.3 

vers 

3.3 

plein 

3.4 

or 

3.4 

boire 

3.4 

autour 

3.4 

ordonner 

3.5 

faim 

3.5 

puis 

3.4 

suivre 

3.4 

plaire 

3.5 

presque 

3.5 

envoyer 

3.5 

depuis 

3.6 

ainsi 

3.6 

peur 

3.6 

croire 

3.6 

doux 

3.6 

rentrer 

3.6 

fer 

3.6 

frais 

3.6 

montre 

3.7 

oreille 

3.7 

pleurer 

3.7 

bientdt 

3.7 

rSgle 

3.7 

chez 

3.8 

verre 

3.7 

prdt 

3.7 

remplir 

3.7 

dont 

3.8 

fou,  fol 

3.8 

sauver 

3.7 

traduire 

3.8 

lorsque 

4.0 

joum6e 

4.0 

soie 

3.8 

bout 

3.9 

Soulier 

4.0 

surtout 

4.0 

tant 

3.9 

apprendre 

4.1 

parattre 

4.2 

loin 

4.2 

craindre 

4.2 

couteau 

4.1 

dejeuner 

4.2 

falloir 

4.3 

sentir 

4.3 

coup 

4.1 

aussit6t 

4.5 

court 

4.4 

mener 

4.4 

devenir 

4.4 

moindre 

4.5 

tort 

4.5 

r6ussir 

4.6 

nul 

4.6 

autant 

4.8 

sourire 

4.7 

soif 

4.7 

minuit 

4.7 

lien 

5.2 

quoique 

5.0 

afin  que 

4.9 

loi 

4.8 

valoir 

5.4 

appartenir 

5.3 

pourvu  que 

5.3 

suffire 

5.7 

179.6 

179.6 

179.6 

179.4 

Tables  III  and  IV  give  the  results  with  these  tests  for  sixteen 
schools  in  terms  of  the  number  right  and  the  sum  of  the  scale 
values. 
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TABLE  III.      NUMBER  CORRECT 


Test 

Years  of  Instruction 

in  French 

0.5 

1.0 

1.5 

2.0 

3.0 

A 
B 
C 
D 

22.1 
25.7 
22.4 
29.3 

32.4 
32.6 
31.6 
32.7 

45.4 
44.9 
42.2 
43.7 

47.6 
47.8 
46.6 
47.0 

53.3 
53.5 
52.3 
52.6 

Average 

24.9 

32.3 

44.1 

47.2 

52.9 

TABLE  IV.      SUM  OF  SCALE  VALUES 


Test 

Years  of  Instruction 

in  French 

0.5 

1.0 

1.5 

2.0 

3.0 

A 
B 
C 
D 

59.1 
69.3 
60.5 
77.0 

87.1 
87.2 
86.4 
87.7 

124.6 
124.5 
114.2 
121.3 

132.8 
134.8 
131.1 
132.3 

154.7 
156.1 
150.7 
151.1 

Average 

66.5 

87.1 

121.1 

132.7 

153.1 

Tentative  standard  scores  for  the  four  vocabulary  tests  are, 
therefore,  as  given  in  Table  V. 


TABLE  V.      AVERAGE  OF  SCORES  FOR  THE  FOUR  TESTS 


Years  of  Instruction 

in  French 

0.5 

1.0 

1.5 

2.0 

3.0 

Number  correct 

25 

32 

44 

47 

53 

Sum     of     scale 
values 

66 

87 

121 

133 

153 

When  the  tests  are  given  the  score  may  simply  be  represented 
by  the  number  of  words  correct.    It  is  more  accurate,  however, 
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to  give  the  weight  or  scale  value  for  each  correct  word  and  take 
the  sum  of  the  scale  values  as  the  score. 

Sentence  Tests 

Seventy-five  sentences,  containing  no  words  not  in  the  list  of 
448  common  to  all  the  first  year,  were  selected  or  constructed  and 
arranged  in  five  sentence  tests  of  as  nearly  equal  difficulty  as 
could  be  estimated.  A  large  number  of  sentences  were  selected 
from  exercise  and  composition  books  used  with  first-  and  second- 
year  pupils.  The  sentences  were  selected  in  this  way  in  order 
that  tests  which  might  be  developed  would  be  based  upon  the 
sort  of  material  the  pupils  are  usually  called  upon  to  work  with, 
and,  moreover,  such  material  would  lend  itself  readily  to  the  de- 
velopment of  construction  or  grammar  tests. 

Table  VI  gives  the  results  obtained  from  these  seventy-five 
sentences  in  eighteen  schools  distributed  widely  over  the  country. 
As  before  the  average  and  median  scores  are  given  and  the  num- 
ber of  pupils.  While  the  tests  were  given  to  half-year,  year-and- 
a-half,  and  three-year  pupils,  the  results  are  not  used  in  the  cal- 
culation of  scale  values. 


TABLE  VI.     RESULTS  FOR  THE  SEVENTY-FIVE  SENTENCES  ARE  AR- 
RANGED IN  THE  ORIGINAL  FIVE  SENTENCE  TESTS.      ALL 
SCHOOLS    COMBINED 


Tests 

First- Year  Pupils 

Second- Year  Pupils 

No.  of 
Pupils 

Averages 

Medians 

No.  of 
Pupils 

Averages 

Medians 

I 
II 

m 

IV 
V 

488 
474 
414 
507 
408 

7.8 
7.0 
7.0 
7.6 
7.8 

8.3 
7.4 
7.5 
7.9 
8.9 

88 
103 
116 
132 
125 

10.7 
10.4 
10.5 
10.0 
12.3 

11.8 
11.5 
10.9 
10.8 
12.5 

Table  VII  gives  (a)  the  percent  of  times  each  of  the  seventy- 
five  sentences  is  correctly  translated  by  first-  and  second-year  pu- 
pils; (b)  the  year  scale  values  (derived  by  the  same  method  as  was 
used  with  vocabularies  described  above) ;  and  (c)  the  general  scale 
value  or  weight  to  be  assigned  to  each  sentence. 
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TABLE  Vn.      THE  SEVENTY-FIVE  SENTENCES  GIVEN  TO  FIRST-  AND 
SECOND-YEAR  PUPILS 


Percents 
Correct 


8. 

9. 
10. 
11. 
12. 

13. 
14, 
IS. 

16. 

17. 
18. 
19. 
20. 
21. 

22. 

23. 
24. 
25. 
26. 
27. 

28. 
29. 
30. 


J'ai  un  irhie 

Ce  livre  est  petit 

II  n'a  pas  d'argent 

La  jeune  fille  a  les  yeux  bleus 

J'y  suis  all6  ce  matin 

n  vient  de  vendre  ce  cheval  quatre  cents 

francs 

On  trouve  que  la  vie  est  ch6re  dans  les 

grandes  villes 

II  mangea  trSs  peu  quoiqu'il  eftt  faim 

Reste  avec  nous  o6  il  fait  chaud 

H  I'a  fait  sans  qu'on  le  lui  ait  dit 

J'ai  dd  partir  sans  vous  attendre 

Si  vous  connaissez  ce  monsieur  qui  vient 

d'arriver,  dites-moi  son  nom 

Elles  se  parlent  I'une  k  I'autre 

Je  I'ai  vu  il  y  a  quelques  heures 

Aussit6t  qu'il  a  eu  fini  son  travail,  ses  amis 

sont  arriv6s 

C'est  vrai 

Le  chien  est  I'ami  de  I'homme 

H  est  difficile  de  faire  cela 

Quel  est  le  livre  que  vous  avez  a  la  main? .... 

Je  ne  le  dirai  pas  S.  vous 

C'est  pourquoi  nous  ne  sommes  pas  all6s  sur 

I'eau 

J'ai  d6ji  6t6  le  voir 

H  devait  arriver  hier 

Qu'est-ce  que  fa  veut  dire? 

Je  ne  crains  pas  qu'il  ne  soit  pas  venu 

H  y  a  un  mois  que  je  le  connais 

H  a  de  son  c6t6  quelque  chose  k  dire,  il  me 

semble 

S'il  a  le  temps,  dites-lui  d'y  aller 

Qui  pourra  le  sauver  si  ce  n'est  ses  amis 

Et  quand  cela  aurait  6t6  vrai,  je  ne  I'aurais 

pas  dit 


96.3 
97.5 
90.4 
95.1 
43.4 

11.1 

73.9 

25.8 
53.5 
19.7 
17.0 

25.4 
48.7 
34.2 

52.9 
85.4 
95.3 
86.0 
93.2 
48.6 

50.7 
61.3 
29.6 
10.0 
15.2 
10.4 

23.9 
54.1 
24.5 

15.9 


II 


96.6 
100.0 
89.8 
95.5 
65.8 

37.5 

89.8 
51.1 
81.8 
44.3 
48.8 

56.8 
67.0 
68.2 

78.4 
94.2 
97.1 
90.3 
98.1 
82.5 

79.6 
85.4 
63.1 
31.1 
39.8 
32.0 

68.0 
83.5 
54.4 

40.8 


Year 
Scale 
Values 


1.2 
0.9 
1.9 
1.4 
4.0 

5.6 

2.9 
4.8 
3.7 
5.1 
5.2 

4.8 
3.8 
4.4 

3.7 
2.2 
1.3 
2.2 
1.6 
3.9 

3.8 
3.4 
4.6 
5.7 
5.3 
5.7 

4.9 
3.6 
4.8 

5.3 


II 


1.1 
0.0 
1.9 
1.3 
3.2 

4.3 

1.9 
3.8 
2.5 
4.0 
3.8 

3.5 
3.1 
3.1 

2.6 
1.5 
1.0 
1.9 
0.7 
2.4 

2.6 
2.2 
3.3 
4.5 
4.2 
4.5 

3.1 
2.4 
3.6 

4.1 
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TABLE  VII— CONTINUED 


31.  II  est  heureux 

32.  Le  vent  et  la  neige  sont  arrives 

33.  Oui,  maintenant  il  y  est 

34.  Je  suis  ici  depuis  trois  jours 

35.  Je  n'ai  parld  k  personne 

36.  Vous  6crirez  ce  qu'il  vous  plaira 

37.  II  me  I'a  dit  lui-m^me 

38.  J'ai  peur  qu'il  ne  vienne 

39.  Je  vous  donnerai  ce  dont  vous  avez  besoin . . . 

40.  Je  ne  sais  pas  pourquoi  nos  amis  ne  sont  pas 

encore  revenus 

41.  Je  resterai  ici  pour  qu'ils  puissent  me  trouver 

42.  Si  je  m'en  vais,  ce  n'est  pas  que  je  veuille 

vous  quitter 

43.  lis  ont  dit  qu'ils  me  feraient  savoir  quand  ils 

arriveraient 

44.  Le  soleil  se  leve  de  tres  bon  matin  et  couche 

si  tard  que,  k  huit  heures,  il  fait  encore  jour 

45.  Peu  s'en  faut  qu'il  ne  le  fasse 

46.  Qui  est  l£L? 

47.  La  nuit  tombe 

48.  Je  suis  votre  ami,  n'est-ce  pas? 

49.  II  est  diflScile  de  lui  plaire 

50.  Est-ce  qu'il  n'est  pas  ici? 

51.  Cette  montre  vaut  vingt  francs 

52.  II  a  perdu  son  chemin 

53.  Combien  y  a-t-il  d'ici  i  votre  maison? 

54.  Avez-vous  jamais  vu  quelque  chose  d'aussi 

beau? 

55.  Je  comprends  maintenant  que  c'6tait  mon 

devoir 

56.  II    s'y    trouve    de    belles    choses 

57.  On  m'a  dit  que  ce  n'est  pas  vrai 

58.  II  viendrapourvu  qu'il  ne  fasse  pas  froid. . . . 

59.  J'irai  le  trouver  si  vous  n'y  allez  vous-m^me. 

60.  Faites  semblant  d'etre  content  afin  que  les 

autres  n'aient  pas  peur 


Percents 
Correct 


91.6 
86.9 
75.4 
34.8 
83.6 
21.9 
50.2 
6.3 
60.1 

61.1 
50.2 

21.5 

30.0 

20.5 
9.4 
92.3 
83.0 
97.4 
61.3 
77.3 
44.0 
51.9 
29.2 

54.8 

20.9 
9.1 

73.8 
10.8 
41.8 

9.7 


II 


93.9 
92.2 
87.1 
67.2 
92.2 
64.7 
82.7 
12.9 
83.6 

87.1 
80.2 

58.6 

73.3 

71.5 
6.0 
95.4 
89.4 
99.2 
81.1 
84.1 
72.7 
84.9 
33.3 

82.6 

59.1 
3.8 
90.9 
22.0 
65.1 

40.9 


Year 
Scale 
Values 


Gen- 
eral 
Scale 
Values 


1.8 
2.1 
2.8 
4.4 
2.4 
5.0 
3.9 
6.1 
3.4 

3.4 
3.8 

5.0 

4.6 

5.0 
5.8 
1.7 
2.4 
0.9 
3.4 
2.7 
4.0 
3.8 
4.6 

3.6 

5.0 
5.8 
2.9 
5.6 
4.1 

5.7 


II 


1.5 
1.7 


2.4 
5.5 
2.4 

2.1 

2.5 

3.5 

2.9 

3.0 
6.1 
1.3 
1.9 
0.2 
2.5 
2.3 
2.9 
2.3 
4.4 

2.4 


4.1 


1.6 
1.9 
2.4 
3.7 
2.0 
4.1 
3.1 
5.8 
2.9 

2.7 
3.1 

4.2 

3.7 

4.0 
5.9 
1.5 
2.1 
0.5 
2.9 
2.5 
3.4 
3.0 
4.5 

3.0 

4.2 
6.1 
2.3 
5.2 
3.6 

4.9 
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TABLE   Vn — CONTINUED 


61.  La  mSre  aime  I'enfant 

62.  Mon  travail  est  fini 

63.  lis  sont  k  I'dcole 

64.  Tout  le  monde  est  ici  aujourd'hui 

65.  H  doit  arriver  demain 

66.  Cet  arbre  est  plus  haut  que  le  n6tre 

67.  D  parait  qu'il  est  mort 

68.  VoilS.  ce  qui  me  plait 

69.  Je  cherche  un  pays  oh  je  puisse  fetre  libre 

70.  J'ai  peu  dormi  cette  nuit 

71.  Si  vous  6tiez  rest6  ici,  j'aurais  €t6  content — 

72.  Que  ne  lui  avez-vous  dit  tout  ce  qui  s'est 

pass6? 

73.  Ne  vous  semble-t-il  pas  qu'il  est  fou? 

74.  Je  ne  veux  pas  qu'il  y  aille 

75.  H  leur  a  demand^  de  I'argent,  mais  ils  ne  lui 

ont  rien  donn6 


Percents 
Correct 


84.6 
83.1 
88.7 
88.5 
33.3 
67.2 
12.8 
62.2 
47.8 
41.7 
38.2 

15.7 
23.5 
38.1 

62.0 


II 


96.0 
94.4 
97.6 
96.8 
73.6 
91.2 
70.4 
88.0 
92.8 
66.4 
73.6 

46.4 
73.6 
80.8 

90.4 


Year 
Scale 
Values 


2.3 
2.4 
2.0 
2.0 
4.4 
3.1 
5.5 
3,3 
3.9 
4.1 
4.2 

5.3 
4.9 
4.2 

3.3 


II 


1.2 
1.4 
0.9 
1.1 
2.9 
1.8 
3.0 
2.1 
1.6 
3.2 
2.9 

3.9 
2.9 
2.5 

1.9 


Gen- 
eral 
Scale 
Values 


1.7 
1.9 
1.4 
1.5 
3.6 
2.4 
4.2 
2.7 
2.7 
3.6 
3.5 

4.6 
3.9 
3.4 

2.6 


The  sentences  were  then  rearranged  into  six  standard  sentence 
tests  of  twelve  sentences  each  of  approximately  equal  difi&culty. 
The  tests  are  as  follows: 

FRENCH  SENTENCE  TEST  I 

1.  Je  suis  votre  ami,  n'est-ce  pas? 0.5 

2.  Quel  est  le  livre  que  vous  avez  k  la  main? 1.1 

3.  Tout  le  monde  est  ici  aujourd'hui 1.5 

4.  II  est  difficile  de  faire  cela 2.0 

5.  II  leur  a  demandd  de  I'argent,  mais  ils  ne  lui  ont  rien  donnd 2.6 

6.  Reste  avec  nous  oil  il  fait  chaud 3.1 

7.  J'y  suis  all6  ce  matin 3.6 

8.  Vous  6crirez  ce  qu'il  vous  plaira 4.1 

9.  Que  ne  lui  avez-vous  dit  tout  ce  qui  s'est  pass6? 4.6 

10.  Qu'est-ce  que  ga  veut  dire? 5.1 

11.  J'ai  peur  qu'il  ne  vienne 5.8 

12.  II  s'y  trouve  de  belles  choses 6.1 


40.1 
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FRENCH  SENTENCE  TEST  II 

1.  Le  chien  est  I'ami  de  rhomme 1.1 

2.  Quiest  l£L? l.S 

3.  Le  vent  et  la  neige  sont  arrives 1.9 

4.  On  m'a  dit  que  ce  n'est  pas  vrai 2.3 

5.  Je  cherche  un  pays  oil  je  puisse  fitre  libre 2,7 

6.  Aussit6t  qu'il  a  eu  fini  son  travail,  ses  amis  sont  arriv6s 3.1 

7.  Si  vous  6tiez  rest6  ici,  j'aurais  6t6  content 3.5 

8.  Ne  vous  semble-t-il  pas  qu'il  est  fou? 3.9 

9.  II  mangea  trfes  peu  quoiqu'il  eM  faim 4.3 

10.  Je  ne  crains  pas  qu'il  ne  soit  pas  venu 4.7 

11.  II  y  a  un  mois  que  je  le  connais 5.1 

12.  Peu  s'en  faut  qu'il  ne  le  fasse 5.9 

40.0 
FRENCH  SENTENCE  TEST  III 

1.  La  jeune  fille  a  les  yeux  bleus 1.3 

2.  La  m^re  aime  I'enfant 1.7 

3.  Je  n'ai  parl6  k  personne 2.0 

4.  On  trouve  que  la  vie  est  chSre  dans  les  grandes  villes 2,4 

5.  J'ai  d6j£l  6t6  le  voir 2,8 

6.  C'est  pourquoi  nous  ne  sommes  pas  all6s  sur  I'eau 3.2 

7.  J'irai  le  trouver  si  vous  n'y  allez  vous-mfime 3,6 

8.  II  a  de  son  c6t6  quelque  chose  k  dire,  il  me  semble 4,0 

9.  Qui  pourra  le  sauver  si  ce  n'est  ses  amis 4,2 

10.  II  I'a  fait  sans  qu'on  le  lui  ait  dit 4.5 

11.  Faites  semblant  d'etre  content  afin  que  les  autres  n'aient  pas  peur  4.9 

12.  II  viendra  pourvu  qu'il  ne  fasse  pas  froid 5.2 


39.8 
FRENCH  SENTENCE  TEST  IV 

1.  lis  sont  a  I'dcole 1.4 

2.  Mon  travail  est  fini 1.9 

3.  Cet  arbre  est  plus  haut  que  le  nfitre 2.4 

4.  Je  ne  sais  pas  pourquoi  nos  amis  ne  sont  pas  encore  revenus 2,7 

5.  S'il  a  le  temps,  dites-lui  d'y  aller 3,0 

6.  Cette  montre  vaut  vingt  francs 3,4 

7.  J'ai  peu  dormi  cette  nuit 3.6 

8.  II  devait  arriver  hier 3,9 

9.  II  paralt  qu'il  est  mort 4,2 

10.  J'ai  dfl  partir  sans  vous  attendre 4,5 

11.  Et  quand  cela  aurait  6t6  vrai,  je  ne  I'aurais  pas  dit 4.7 

12.  II  vient  de  vendre  ce  cheval  quatre  cents  francs 4.9 

40.6 
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FRENCH  SENTENCE  TEST  V 

1.  C'est  vrai 1.8 

2.  La  nuit  tombe 2.1 

3.  Oui,  maintenant  il  y  est 2.4 

4.  Voili  ce  qui  me  plait 2.7 

5.  Je  vous  donnerai  ce  dont  vous  avez  besoin 2,9 

6.  Je  resterai  ici  pour  qu'ils  puissent  me  trouver 3.1 

7.  Je  ne  veux  pas  qu'il  y  aille 3.4 

8.  lis  ont  dit  qu'ils  me  feraient  savoir  quand  ils  arriveraient 3.7 

9.  Le  soleil  se  leve  de  tres  bon  matin  et  se  couche  si  tard  que,  k  huit 

heures,  il  fait  encore  jour 4.0 

10.  Si  vous  connaissez  ce  monsieur  qui  vient  d'arriver,  dites-moi  son 

nom 4.1 

11.  Si  je  m'en  vais,  ce  n'est  pas  que  je  veuille  vous  quitter 4.2 

12.  Combien  y  a-t-il  d'ici  k  votre  maison? 4.5 

38.9 
FRENCH  SENTENCE  TEST  VI 

1.  II  n'a  pas  d'argent 1.9 

2.  Est-ce  qu'l  n'est  pas  ici? 2.5 

3.  II  est  difficile  de  lui  plaire 2.9 

4.  .Avez- vous  jamais  vu  quelque  chose  d'aussi  beau? 3.0 

5.  II  a  perdu  son  chemin 3.0 

6.  Je  ne  le  dirai  pas  k  vous 3.1 

7.  II  me  I'a  dit    lui-meme 3.1 

8.  Elles  se  parlent  I'une  k  I'autre 3.4 

9.  II  doit  arriver  demain 3.6 

10.  Je  I'ai  vu  il  y  a  quelques  heures 3.7 

11.  Je  suis  ici  depuis  trois  jours 3.7 

12.  Je  comprends  maintenant  que  c'6tait  mon  devoir 4.2 

38.1 

Table  VIII  gives  the  number  correct  with  each  of  these  tests 
and  the  sum  of  the  scale  values  for  one  year,  a  year  and  one-half, 
two  year,  and  three  year  pupils. 
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TABLE  VIII.     NUMBER  CORRECT 


Years  of  Instruction  in  French 

Test 

1.0 

1.5 

2.0 

3.0 

I 

5.9 

7.4 

7.7 

9.7 

II 

5.8 

7.4 

8.5 

10.0 

III 

5.4 

7.2 

8.2 

8.6 

IV 

5.2 

7.3 

8.7 

10.4 

V 

5.7 

7.5 

9.0 

10.5 

VI 

6.1 

8.3 

9.2 

11.0 

Average 

5.7 

7.5 

8.5 

10.0 

TABLE  IX.     SUM  OF  SCALE  VALUES 


Test 

Years  of  Instruction  in  French 

1.0 

1.5 

2.0 

3.0 

I 

II 

III 

IV 

V 

VI 

12.7 
14.1 
14.0 
14.2 
16.2 
18.1 

17.3 
19.6 
20.0 
21.3 
22.5 
26.0 

18.8 
23.2 
23.6 
26.8 
27.5 
30.0 

28.1 
30.5 
29.0 
34.1 
32.6 
33.7 

Average 

14.9 

21.1 

25.0 

31.3 

Tentative  standard  scores,  disregarding  the  minor  differences 
between  the  tests,  would,  therefore,  be  as  follows : 

TABLE  X.     AVERAGE  OF  SCORES  FOR  THE  SIX  TESTS 


Years  of  Instruction  in  French 

1.0 

1.5 

2.0 

3.0 

Number  correct 

5.5 
14.0 

7.5 
21.0 

8.5 
24.0 

10.0 

Sum  of  scale  values 

31.0 

These  scores  are  very  reliable  for  the  one  year  and  two  year 
pupils  but  less  so  for  the  year  and  a  half  and  three  year  pupils. 


THE  OTIS  GROUP  INTELLIGENCE  SCALE  APPLIED 

TO  THE  ELEMENTARY-SCHOOL  GRADUATING 

CLASSES  OF  OAKLAND,  CALIFORNIA 

Virgil  E.  Dickson  and  John  K.  Norton 
Bureau  of  Research  and  Guidance,  Public  Schools,  Oakland,  California 

Both  individual  and  group  intelligence  tests  have  been  ex- 
tensively used  in  the  public  schools  of  Oakland,  California  for  a 
number  of  years.  Their  value  as  administrative  tools  is  well  es- 
tablished. They  have  contributed  to  a  better  understanding  of 
many  school  problems  such  as  retardation,  elimination,  and  proper 
curriculum  modification;  and  they  have  resulted  in  administra- 
tive adjustments  leading  to  greater  efl&ciency. 

This  article  presents  certain  data  from  tests  of  1,043  day  ele- 
mentary-school pupils  who  completed  the  eighth  grade  in  Oak- 
land, January,  1920.  This  includes  all  those  graduated  at  that 
time  except  a  small  number  who  were  absent  from  school  the  day 
the  tests  were  given.  The  Otis  Group  Intelligence  Scale,  as  ab- 
breviated for  use  in  Oakland,  was  employed  in  making  the  tests. 
The  abbreviation  omits  tests  1,  6,  9,  and  10.  It  includes  tests  2, 3, 
4,  5,  7,  and  8  without  modification  as  to  directions  for  giving, 
timing,  or  scoring,  except  that  tests  4  and  5  are  given  double 
value  in  the  final  score  in  order  that  they  may  contribute  a  greater 
amount  to  the  final  test  result.  The  highest  possible  score  with 
the  abbreviated  test  is  175. 

In  order  that  the  six-test  scores  obtained  at  Oakland  may  be 
compared  with  the  scores  arising  from  the  use  of  the  complete 
test.  Dr.  Arthur  S.  Otis,  the  deviser  of  the  test,  has  furnished 
Table  I.  By  its  use  a  ten-test  score  may  be  transmuted  into  a 
six-test  score. 

The  tens  and  hundreds  digits  of  the  six- test  score  are  printed 
in  italics  in  the  line  across  the  top;  the  units  digits  of  the  six- test 
score  are  printed  in  italics  in  the  column  at  the  left.  To  find  the 
ten-test  score  corresponding  to  a  known  six-test  score  find  in  the 
body  of  the  table  the  number  under  the  tens  digit  (or  tens  and 
hundreds  digits  combined)  and  opposite  the  units  digit.    For  ex- 
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TABLE  I.      A  TABLE  FOR  TRANSMUTING  TEN-TEST  SCORES  INTO  SIX- 
TEST  SCORES,  OMITTING  TESTS   1,  6,  9,  AND   10.      (OTIS 
GROUP  INTELLIGENCE   SCALE) 


Units 
Digits  of 

Tens  and  Hundreds  Digits  of  Six-test  Score 

Six-test 

Score 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

1 

10 

26 

42 

58 

74 

91 

107 

123 

140 

154 

167 

181 

195 

2 

11 

27 

43 

60 

76 

92 

109 

125 

141 

155 

168 

182 

196 

3 

13 

29 

45 

61 

78 

94 

110 

127 

143 

157 

170 

184 

198 

4 

14 

30 

46 

63 

79 

96 

112 

128 

144 

158 

171 

185 

199 

5 

16 

32 

48 

64 

81 

97 

114 

130 

146 

160 

173 

187 

201 

6 

18 

34 

50 

66 

82 

99 

115 

132 

147 

161 

174 

188 

202 

7 

19 

35 

51 

68 

84 

100 

117 

133 

148 

162 

175 

189 

203 

8 

21 

37 

53 

69 

86 

102 

118 

135 

150 

163 

177 

191 

205 

9 

22 

38 

55 

71 

87 

104 

120 

136 

151 

164 

178 

192 

206 

0 

24 

40 

56 

73 

89 

105 

122 

138 

153 

166 

180 

194 

208 

ample  the  following  six-test  scores  correspond  to  the  indicated 
ten- test  scores: 

Six-test  Ten-test 

Score  Score 

45 81 

125 201 

22 43 

10 24 

4 14 

The  tests  were  made  in  the  school  month  just  preceding  the 
date  of  graduation.  At  the  time  of  making  the  test,  the  following 
supplementary  data  were  obtained  for  each  child:  name,  age  in 
years  and  months,  date  and  hour  of  the  test,  and  teachers'  ratings 
in  school  work.  Teachers  were  asked  to  rate  pupils  for  general 
quality  of  school  work  on  a  scale  of  seven  points  as  follows:  (1) 
very  superior;  (2)  superior;  (3)  slightly  above  average;  (4)  av- 
erage; (5)  slightly  below  average;  (6)  inferior;  (7)  very  inferior. 

When  several  teachers  rated  a  child  in  school  work,  the  average 
of  their  ratings  was  taken.  If  this  resulted  in  a  fraction,  the 
child  was  assigned  the  rating  of  the  nearest  whole  number.  When 
the  fraction  was  an  even  half,  the  rating  was  given  the  value  of  the 
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whole  number  farthest  removed  from  the  rating  of  4.  That  is  3.5 
was  tabulated  as  3,  4.5  as  5,  etc.  Succeeding  paragraphs  present 
and  briefly  point  out  the  significance  of  the  data  resulting  from 
the  test  and  the  collection  of  the  supplementary  information. 

Table  II  gives  distributions  of  scores  made  by  graduating 
classes  of  the  29  schools  of  the  city.  A  wide  variation  in  capacity 
as  measured  by  the  test  is  shown  both  by  different  high  eighth 
grades  and  by  different  individuals  in  the  same  class.  Individual 
scores  range  from  14  to  152  points  and  class  medians  from  48  to 
109.  The  significance  of  these  differences  can  be  better  under- 
stood by  consulting  Figure  1.  This  compares  the  ranges  of  the 
middle  50  percents  for  four  different  groups:  (1)  the  elementary 
graduating  classes  of  the  two  schools  making  the  highest  medians; 
(2)  a  high  ninth-grade  class  of  average  ability  tested  at  about  the 
same  time  as  the  elementary  graduating  classes;  (3)  the  elemen- 
tary graduating  classes  in  the  three  schools  making  the  lowest 
median  scores;  (4)  two  high  sixth-grade  classes  recently  tested. 


MIGHEOT    S"!^  GRADL3. 
HIGM      g"!^     GRADL 
LCWtST    6Vi-   qRADE.0 


f^T 


ih 


tlIGM      6"^    GRAOCO 
OTIS      .SCORE- 


I 1 1 1 r- 

,50     -vo     50     60     70 


&o 


— T 1 1 1 1 

90       100      110      120     130 


F\G\JRL     I. 


RANGE.    OF    OTIO     T"L5  T        JSCORtS 

MIDDLE.  nriY         PtB.CE.NT. 


It  is  evident  that  ability  as  measured  by  the  test  in  the  eighth- 
grade  classes  in  some  of  the  schools  is  equal  to  that  in  a  freshman 
class  which  has  survived  a  year  in  high  school  and  is  just  ready  to 
begin  sophomore  work;  while  the  ability  found  in  other  eighth 
grades  is  no  better  than  that  of  groups  of  children  who  have  not 
yet  completed  the  sixth  grade.     If  the  test  means  anything  in 
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terms  of  ability  to  do  school  work,  certainly  the  actual  accomplish- 
ments of  the  different  classes  graduating  in  January,  1920  must 
have  varied  widely. 

These  data  show  how  important  it  is  to  know  the  character  of 
the  human  material  with  which  a  teacher  is  working,  before  a  judg- 
ment is  passed  on  the  results  obtained.  A  poor  teacher  working 
with  an  eighth-grade  class  with  the  capacity  of  high-school  fresh- 
men might  very  easily  get  better  results  than  a  good  teacher  work- 
ing with  an  eighth-grade  class  with  a  capacity  not  above  that  of 
the  ordinary  sixth  grade.  Teachers  are  too  often  judged  wholly 
on  a  basis  of  results,  whereas  the  important  factor,  the  learning 
capacity  of  children,  is  given  but  Uttle  thought. 

The  necessity  of  making  modifications  in  the  curriculum  to 
meet  the  varying  abilities  of  different  classes  of  the  same  grade 
designation,  and  of  different  individuals  in  the  same  class,  is  an- 
other point  emphasized  by  the  data  of  Table  II. 

Modifications  certainly  must  be  made  either  in  the  character 
of  the  curriculum  or  in  the  time  given  by  different  classes  of  the 
same  grade  to  any  particular  block  of  subject-matter  if  proper 
consideration  is  to  be  given  to  the  wide  differences  in  capacity 
which  the  test  reveals  in  grades  of  the  same  designation. 

Table  III  gives  the  data  concerning  the  relationship  between 
test  scores  and  ratings  in  school  work.  There  is  a  positive  cor- 
relation of  0.538  (Pearson  formula).  Even  were  the  test  perfect 
in  its  measurement  of  mental  capacity,  we  should  not  expect  a 
complete  correlation  between  test  scores  and  school  work.  Such 
factors  as  the  following  all  tend  to  destroy  correlation: 

1.  All  children  do  not  put  forth  equal  effort;  some  of  good 
native  ability  may  do  poor  work  due  to  lack  of  application,  and 
some  of  poor  native  ability  may  compensate  by  unusual  effort. 

2.  Repetition  of  grades  sometimes  brings  up  the  school  work 
of  those  of  poor  native  abiUty. 

3.  Desirable  or  undesirable  personal  characteristics  may  un- 
duly influence  a  teacher  in  her  estimate  of  a  child's  work. 

4.  Different  classes  of  the  same  grade  vary  so  widely  in  general 
abiUty  that  the  same  score  may  represent  high  or  low  ability,  ac- 
cording to  the  class  in  which  it  occurs. 

5.  In  a  small  number  of  cases  the  test  score  is  probably  unduly 
influenced  by  extreme  nervousness,  illness,  or  other  interfering 
factors. 
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TABLE  III.      OTIS  SCALE  SCORE  AND  RATING  IN  SCHOOL  W0RK(<»1 


School  Work  Rating 

Score 

. 

Totals 

7 

6 

5 

4 

3 

2 

1 

150 

1 
1 

3 

3 

6 

10 

1 
4 
4 
2 
1 
1 

1 

145 

2 

140 

2 
1 
1 
9 
10 

6 

135 

8 

130 

4 
4 

5 

10 

125 

1 

21 

120 

1 

27 

115 

3 

7 

10 
11 

21 
14 
21 

8 
16 

7 

2 
4 

41 

110 

44 

105 

1 

3 

43 

100 

1 

12 

25 

17 

8 

63 

95 

1 

6 

29 

12 

7 

2 

57 

90 

1 

7 

46 

26 

13 

2 

95 

85 

1 

9 

34 

23 

9 

76 

80 

1 

13 

32 

15 

12 

73 

75 

1 

7 

11 

31 

10 

7 

2 

69 

70 

1 

7 

23 

36 

11 

4 

82 

65 

4 

7 

23 

20 

11 

3 

2 

70 

60 

2 
1 

8 
8 

12 
21 

28 
11 

11 
6 

61 

55 

1 

48 

50 

4 

10 

10 

10 

4 

1 

39 

45 

2 

1 

2 

1 

9 
4 
6 

3 

2 

1 

6 
6 
1 
4 
2 
3 
1 

5 
3 
2 

9 

31 

40 

14 

35 

9 

30 

1 

10 

25 

4 

20 

2 

7 

15-19 

1 

10-14 

1 

1 

Totals 

19 

80 

177 

355 

235 

120 

27 

1013 1« 

Median  Scores 

54 

57 

70 

85 

93 

102 

119 

84 

r=0.  538. 

[a]  Read  table  as  follows:  Of  the  pupils  rated  7  (very  inferior)  in  school  work  one  scored  between 
75  and  79;  one  scored  between  70  and  74;  etc.  Of  those  rated  6  (inferior),  one  scored  between  120  and 
124:  one  between  105  and  109;  etc. 

\b]  Thirty  pupils  included  in  Table  II  are  omitted  as  they  had  not  been  in  the  Oakland  schools  a  suffi- 
cient time  to  make  it  possible  for  teachers  to  rate  them  in  school  work . 
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6.  The  degree  of  homogeneity  of  the  group  tested  is  an  impor- 
tant consideration  in  estimating  the  value  of  a  correlation  figure. 
The  group  dealt  with  here,  high  eight-grade  children,  is  probably 
as  homogeneous  as  is  found  in  any  grade. 

But  in  spite  of  all  these  factors  that  tend  to  destroy  correla- 
tion, the  test  score  gives  a  good  indication  of  the  character  of 
school  work  a  child  will  do.  Table  IV,  worked  out  on  the  percent- 
age basis,  is  more  conclusive  on  this  point  than  the  correlation 
figure.  Of  the  fifty  children  composing  the  5  percent  making  the 
highest  test  scores,  none  were  rated  7  in  school  work,  none  were 
rated  6,  2  percent  were  rated  5  or  below  average,  and  the  rest  were 
rated  average  or  above.  School  ratings  for  the  other  percent- 
age groups  are  also  given.  These  ratings  show  conclusively 
that  the  test  score  is  a  valuable  indication  of  the  type  of  work 
children  do. 

The  data  contained  in  Table  V  show  the  relation  between 
chronological  age  and  test  scores  for  the  1,043  children.  The 
younger  children  in  the  grade  generally  made  the  higher  scores 
in  the  test.  Those  who  were  twelve  years  old  made  a  median 
score  of  110,  and  there  was  a  marked  drop  in  the  median  of  each 
higher  age  group.  In  short,  the  bright  children  who  learn  rapidly 
and  earn  extra  promotions  made  high  scores  on  the  test,  while  the 
over-age  plodders,  in  spite  of  the  extra  years  they  have  spent  in 
school,  show  their  mental  inferiority  by  making  low  scores.  Of 
the  44  children  who  were  seventeen  years  of  age,  82  percent  made 
scores  below  the  median  for  the  whole  group,  while  of  those  twelve 
years  of  age,  82  percent  were  above  the  median. 


TABLE  IV.    OTIS  SCALE  SCORE  AND  RATING  IN  WORK  IN  PERCENTSI«1 

PercentUe 
(Otis  Scale) 

School  Work  Rating^*! 

1            .           .            1 

Totals 

7 

6 

5     1     4 

3 

2     1      1 

95  to  100 

0 

0 

2.0 

18 

26 

30 

24 

100 

85  to  95 

0 

0.9 

1.9 

18.8 

43.5 

30.6 

3.9 

99.6 

65  to  85 

0 

1.4 

12.3 

40.3 

28.0 

15.2 

2.4 

99.6 

35  to  65 

0.6 

3.2 

14.1 

46.0 

23.0 

11.5 

1.3 

99.1 

15  to  35 

2.9 

11.3 

28.5 

36.4 

15.7 

3.4 

0.9 

99.1 

5  to  15 

6.9 

22.7 

29.7 

21.7 

17.8 

0.9 

0 

99.7 

Oto5 

7.8 

37.2 

35.2 

17.6 

1.9 

0 

0 

99.7 

to]  Read  table  as  follows:  of  the  highest  5  percent  of  the  group  according  to  Otis  test  scores,  none 
were  rated  7  in  school  work,  none  were  rated  6,  2  i>ercent  were  rated  5,  etc. 
[6J  "1"  in  school  work  is  very  superior, 
"2"  in  school  work  is  superior, 
"3"  in  school  work  is  slightly  above  average,  etc.,  see  above. 
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TABLE   V.      OTIS  GROUP  INTELLIGENCE  SCALE  SCORE  AND  CHRONO- 
LOGICAL AGE.      1,043  GRADUATING  ELEMENTARY- 
SCHOOL   CHILDREN^ 


Ages 

Score 

Totals 

1116] 

12 

13 

14 

15 

16 

17 

150-159 

1 

1 
1 

1 

1 

140-149 

4 

7 

2 
5 

1 

3 

8 

130-139 

2 

19 

120-129 

1 

13 

22 

9 

3 

48 

110-119 

4 

24 

36 

15 

5 

1 

85 

100-109 

1 

19 

44 

34 

8 

106 

90-99 

3 

23 

54 

56 

14 

4 

154 

80-89 

2 

30 

52 

52 

12 

4 

152 

70-79 

1 

15 

53 

57 

28 

5 

159 

60-69 

1 

7 

42 

46 

27 

8 

131 

50-59 

4 

24 
11 

2 

4 

31 

24 

8 

2 

24 

13 

7 

4 

9 

5 
4 
2 
2 

92 

40-49 

53 

30-39 

21 

20-29 

12 

10-19 

2 

Totals 

1 

16 

146 

351 

338 

147 

44 

1,043 

Median  Score 

134W 

110 

94 

84 

80 

i    70 

60 

83 

r 0.44. 

[a]  Read  table  as  follows-    One  child  aged  eleven  scored  between  130  and  139;  one  aged  twelve  scored 
between  150  and  159;  one  aged  fifteen  scored  between  140  and  149;  etc. 

[b]  Age  eleven  includes  those  from  ten  years  and  six  months  to  eleven  years  and  five  months;  age 
twelve  from  eleven  years  and  six  months  to  twelve  years  and  five  months. 

\c\  Score  of  one  case. 


Figure  2  compares  the  range  of  the  middle  50  percent  of  each 
age  group.  It  would  be  hard  to  present  data  more  conclusive 
than  these  regarding  the  value  of  the  test  as  a  measure  of  the  ca- 
pacity for  accomplishment  in  school  work  as  it  is  now  constituted. 

The  administrative  uses  to  which  intelligence-test  results  may 
be  put  are  many.  They  may  be  used  in  studying  pupils  in  groups; 
that  is,  the  human  material  in  one  school  can  be  compared  with 
that  in  another.  The  classes  of  the  same  grade  and  of  different 
grades  within  a  school  can  also  be  accurately  measured  as  to  gen- 
eral capacity.     The  group  intelligence  test  has  already  been  used 
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successfully  in  some  of  the^Oakland  schools  as  an  aid  in^making 
pupil  segregations  on  the  basis  of  ability  to  do  school  work. 

The  test  results  are  also  of  value  in  studying  individual  pupils. 
The  results  are  not  as  reliable  in  the  measurement  of  individuals 
as  in  the  measurement  of  classes,  but  if  they  are  used  cautiously, 
they  are  sufficiently  accurate  to  render  valuable  information  con- 
cerning individual  pupils.  Following  are  some  of  the  ways  in 
which  test  scores  may  be  used  in  dealing  with  individual  pupils: 

1.  A  low  score  may  help  to  confirm  a  teacher's  judgment  that 
a  child's  failure  in  school  is  due  to  inferior  capacity.  Special  steps 
can  then  be  taken  to  insure  the  best  development  of  what  ability 
the  child  is  found  to  possess. 

2.  A  high  score  associated  with  poor  school  work  should  call 
for  special  study.  The  child  may  be  failing  because  of  lack  of 
application;  or  such  factors  as  excessive  diffidence,  poor  sight,  de- 
fective hearing,  or  bad  home  conditions  may  explain  why  a  child 
sometimes  makes  a  high  score  and  yet  does  poor  school  work.  At 
any  rate,  all  such  cases  are  worth  careful  investigation  to  see  if 
conditions  cannot  be  remedied  so  that  the  child  will  work  up  to 
capacity.  Cases  are  already  on  record  in  the  Oakland  schools 
where  the  attitude  of  a  child  toward  school  and  the  character  of 
his  school  work  have  both  been  greatly  improved  as  a  result  of  a 
special  case  study  made  after  a  group  test  had  been  given. 

3.  The  test  scores  often  indicate  that  children  should  be  con- 
sidered for  extra  promotions.    When  a  child  makes  an  exception- 
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ally  high  score,  and  it  is  the  judgment  of  his  teachers  that  he  is 
capable  of  doing  work  in  a  higher  grade,  he  should  be  carefully 
studied  with  a  view  to  advancement.  If  no  good  reasons  seem 
to  exist  why  he  should  not  be  put  ahead,  he  should  receive  the 
extra  promotion,  due  provision  being  made  on  account  of  it  for  the 
extra  help  he  will  need.  On  the  other  hand,  when  a  child's  test 
score  and  school  work  seem  to  agree,  there  is  reason  for  satisfac- 
tion that  the  school  is  accomplishing  what  it  should. 

4.  Test  scores  are  valuable  to  teachers  in  educational  and  vo- 
cational counseling.  It  is  only  on  the  basis  of  exact  knowledge 
that  any  effective  advice  can  be  given  to  children  concerning  their 
future  educational  and  occupational  careers.  The  intelhgence 
test  is  one  of  several  "lines"  on  a  pupil's  characteristics  which  a 
school  counselor  should  have  at  hand  when  advising  him. 

5.  The  whole  question  of  the  differentiation  of  the  curriculum 
in  terms  of  the  capacity  and  needs  of  pupils  is  one  in  which  test 
results  can  lend  valuable  aid.  This  problem  is  already  a  pressing 
one  in  the  high  schools  of  some  of  our  cities,  for  these  schools  are 
no  longer  receiving  pupils  selected  almost  entirely  from  the  upper 
25  percent  of  the  general  population.  Indeed  in  some  cities  the 
freshman  high-school  class  already  has  an  enrollment  50  percent 
as  large  as  that  of  the  first  elementary  grade.  Various  cities  re- 
port that  practically  all  elementary-school  graduates  enter  the 
high  school.^  In  short,  our  high  schools  are  now  attended  by 
many  pupils  with  a  mental  capacity  that  is  only  average  or  even 
below  average.  At  the  same  time,  many  high  schools  have  little 
to  offer  these  children  except  a  curriculum  designed  for  the  highly 
selected  college-preparatory  group  that  attended  high  school  a 
few  decades  ago.  How  miserably  this  curriculum  fails,  the  elim- 
ination figures  of  most  high  schools  clearly  show.  The  problem  of 
creating  a  new  curriculum  for  children  of  average  and  below-aver- 
age capacity  is  one  on  which  intelligence  tests  give  valuable  aid. 

These  are  but  a  few  of  the  administrative  uses  to  which  group 
intelligence-test  data  may  be  put.  Caution  is,  of  course,  necessary. 
Tests  have  no  greater  enemy  than  the  inexperienced  and  enthu- 
siastic individual  who  rushes  into  a  program  of  testing  and  accepts 
all  test  results  at  their  face  value. 

^  Of  the  pupils  included  in  this  study,  87  percent  entered  high  school. 


THE  VALUE  OF  THE  WRITTEN  PARAGRAPH  SUMMARY 

Charles  E.  Germane 
College  of  Education,  Des  Moines  University 

A  cursory  glance  through  many  of  our  leading  textbooks  on 
methodology  shows  that  there  is  a  wide  difference  of  opinion 
among  educational  experts  regarding  the  value  of  summarizing 
or  outlining  as  a  method  of  study.  Some  writers  claim  that  ask- 
ing students  to  summarize,  outline,  or  make  a  synopsis  of  their 
lesson  during  the  study  period  insures  the  following:  (1)  the  pupils 
discriminate  in  their  reading  and  (2)  they  organize  what  they  have 
read. 

On  the  other  hand,  many  authors  claim  that  much  time  is 
wasted  in  the  study  period  by  so  much  indiscriminate  note- taking; 
that  pupils  are  too  much  addicted  to  the  "pencil  and  paper" 
habit;  and  that  time  could  be  more  profitably  spent  by  summar- 
izing the  lesson  in  class  at  the  end  of  the  recitation  period. 

However,  since  neither  group  of  writers  had  any  scientific 
evidence  to  offer,  an  attempt  was  made  to  determine  experimen- 
tally the  value  of  one  form  of  summarizing  as  a  method  of  study. 
The  following  is  a  brief  synopsis  of  this  experiment. 

Problem 

Briefly  stated  the  problem  is:  What  is  the  relative  value  of  a 
written  paragraph  summary  of  an  article  compared  with  the  re- 
reading of  the  same  article  for  the  same  length  of  time. 

Method  of  Experimentation 

Selection  of  material. — Since  this  experiment  was  to  be  con- 
ducted in  grades  vi,  vii,  and  viii  of  the  public  schools  it  was  nec- 
essary to  select  material  that  was  neither  too  difficult  for  grade  vi 
nor  too  easy  for  grade  viii.  After  considerable  preliminary  ex- 
perimenting in  the  University  Elementary  School  and  the  Junior 
High  School  of  the  State  University  of  Iowa,  the  four  following 
selections  were  chosen:  (1)  an  article  on  the  "Sweating  System" 
adapted  from  Towne's  Social  Problems;  (2)  an  article  on  "Immi- 
gration" adapted  from  Besiid  3indBsig\ey's  American  History ;  (3) 
an  article  on  "What  We  Should  Know  About  Tuberculosis" 
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adapted  from  a  bulletin  issued  by  the  New  York  State  Depart- 
ment of  Health;  and  (4)  an  article  on  the  "Raising  of  Peanuts" 
adapted  from  the  Farmers^  Bulletin,  No.  431,  issued  by  the  United 
States  Department  of  Agriculture.  These  articles  varied  in  length 
from  seven  to  nine  pages  and  were  particularly  suited  to  this  tjrpe 
of  problem  in  that  they  were  all  highly  factual  and  logically  or- 
ganized. 

Division  of  the  class. — In  order  to  measure  the  relative  value 
of  the  written  paragraph  summary  as  compared  with  re-reading,  it 
was  necessary  to  divide  the  pupils  into  two  groups  of  as  nearly 
equal  comprehension  ability  in  silent  reading  as  possible.  It  was 
desirable  that  the  device  for  the  division  of  the  class  should  be 
like  the  device  for  measuring  the  comprehension  of  the  pupils  in 
the  later  tests.  Hence  it  was  thought  that  a  division  based  on 
the  ability  of  the  pupils  to  read  and  comprehend  one  of  the  four 
articles  previously  mentioned  would  be  as  reliable  a  method  as 
any.  The  article  on  the  sweating  system  was  selected  as  being 
best  suited  for  this  purpose,  since  very  few  of  the  pupils  in  these 
grades  had  ever  read  anything  on  that  subject  and  many  of  them 
did  not  know  what  the  title  meant.  The  pupils  were  asked  to 
read  the  article  through  twice  and  then  were  given  a  rigorous  test 
consisting  of  questions  of  major  and  minor  importance  covering 
the  entire  selection.  The  scores  made  on  this  test  formed  the 
basis  for  the  division  of  the  pupils  into  the  two  groups. 

Further  to  validate  and  justify  this  method  of  dividing  the 
class  into  two  groups  the  four  articles  named  above  were  given  to 
a  group  of  twenty  students  under  similar  conditions.  The  in- 
structions for  the  four  tests  were  identical,  the  pupils  being  asked 
to  read  the  article  twice  and  then  take  the  test.  Table  I  shows 
the  ranks  of  the  pupils  on  the  four  different  tests. 

According  to  the  Spearman  footrule  method  of  computation, 
the  correlations  are  as  follows: 

Sweating  System  and  Peanuts  0 .  42 

Sweating  System  and  Immigration  0 .  70 

Sweating  System  and  Tuberculosis  0 ,  69 

By  using  the  table  in  Rugg's  Statistical  Methods  Applied  to 

Education  to  transfer  these  Spearman  correlations  into  Pearson 

correlations,  the  following  results  are  obtained: 

Sweating  System  and  Peanuts  0 .  64 

Sweating  System  and  Immigration  0 .  90 

Sweating  System  and  Tuberculosis  0.89 
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TABLE  I.      SHOWING  THE  RANKS  OF  THE  TWENTY  PUPILS   ON  THE 
FOUR    TYPES     OF    READING    MATERIAL 


Sweating] 
System 

Peanui'S 

Immigration 

Tuberculosis 

1 

5 

2 

2 

2 

13 

S 

S 

3 

1 

3 

1 

4 

3 

1 

4 

5 

6 

6 

3 

Q. 

6 

2 

7 

8 

7 

16 

4 

9 

8 

4 

10 

7 

9 

14 

14 

,12 

10 

10 

9 

14 

11 

11 

11 

10 

12 

15 

IS 

17 

13 

9 

8 

11 

14 

8 

13 

13 

IS 

7 

19 

IS 

Qi 

16 

18 

12 

6 

17 

20 

16 

16 

18 

19 

18 

18 

19 

12 

17 

20 

20 

17 

20 

19 

Read  table  thus:    The  pupil  who  ranked  1  in  the  test  on  the  sweating  system 
ranked  5  on  peanuts,  2  on  immigration  and  2  on  tuberculosis,  etc. 

These  correlations,  while  not  perfect,  are  high  enough  to  in- 
dicate that  in  this  group  of  pupils,  ability  to  comprehend  one  ar- 
ticle is  closely  correlated  with  ability  to  comprehend  the  other 
articles.  However,  the  relationship  can  better  be  seen  by  com- 
paring the  quartile  distributions  for  the  four  selections.  While 
the  same  student  does  not  maintain  exactly  the  same  rank  in  all 
four  tests,  yet  it  may  be  observed  that  there  is  very  little  change 
in  the  quartile  distribution.  Those  students  who  are  in  the  upper 
quartile  for  the  first  test  are  almost  without  exception  to  be  found 
in  the  same  quartile  for  the  remaining  three  tests. 

Method. — This  experiment  was  conducted  in  grades  vi,  vn, 
and  vin  in  three  representative  public  schools  of  cities  in  Iowa. 
The  number  of  cases  reported  is  900.  The  Summarizing  Group  was 
called  Group  A,  and  the  Re-reading  Group  was  called  Group  B. 
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Both  sections  worked  at  the  same  time  but  in  dififerent  rooms. 
Each  spent  thirty  minutes  in  studying  the  material  and  at  the  end 
of  that  time  each  was  subjected  to  the  same  rigid  test  of  questions 
covering  the  content  of  the  article.  The  tests  were  all  graded  by 
the  writer  and  a  graduate  student  who  had  worked  through  the 
experiment  and  who  knew  it  thoroughly.  The  experimenters  al- 
ternated the  groups,  one  conducting  the  experiment  in  Group  A 
one  day  and  in  Group  B  the  next  day,  in  an  attempt  to  offset  the 
effect  of  personality. 

TABLE   II.      A   COMPARISON   OF   THE   TOTAL   SCORES   MADE   BY   THE 
SUMMARIZING  GROUP   (a)  AND  THE  RE-READING  GROUP  (b)  OF 
GRADES  VI,  VII  AND  VIII  ON  THE  READING  MATERIAL,  PEANUTS 


Grades  and  Groups 

Whole  Test 

First  Half 

Reason 
Questions 

MmoR 
Qxra:sTiONS 

VI 
Group  A 
Group  B 
Group  B  excels 
by  4.1%, 

539 
561 

339 

327 

135 
113 

73 

75 

vn 

Group  A 
Group  B 
Group  B  excels 
by4%o 

600 
624 

335 
339 

144 
161 

98 
88 

VIII 
Group  A 
Group  B 
Group  B  excels 
by  6.2% 

752 
799 

407 
462 

243 
230 

85 
94 

Read  table  thus:  In  grade  vi,  the  aggregate  score  for  Group  A  was  539  on  the 
whole  test,  339  when  only  the  first  half  was  considered,  135  on  the  reason  questions, 
and  73  on  the  minor  questions,  etc. 

In  order  that  the  pupils  in  the  Summarizing  Group  (A)  would 
understand  exactly  what  was  meant  by  summarizing,  ten  min- 
utes were  spent  in  class  in  summarizing  two  short  paragraphs. 
The  experimenter  indicated  the  main  points  and  emphasized  the 
importance  of  speed  and  brevity.  Then  the  pupils  were  given 
the  article  and  instructions  for  the  experiment.    The  pupils  in 
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Group  A  were  asked  to  read  the  article  through  once,  rapidly  and 
carefully.  Then  on  the  summarizing  form  provided,  they  wrote 
the  main  points  or  ideas  of  each  paragraph.  Thirty  minutes  were 
allowed  for  the  reading  and  summarizing  and  at  the  end  of  that 
time  the  pupils  were  submitted  to  a  rigorous  fifteen-minute  test. 
The  pupils  in  the  Re-reading  Group  (B)  were  simply  asked  to 
read  the  article  given  them  as  many  times  as  possible  in  the  thirty- 
minute  period.  The  same  test  was  given  them  at  the  end  of  that 
time  as  was  given  to  the  pupils  in  Group  A. 

Results 

A  careful  analysis  was  made  of  the  written  work  of  the  pupils 
in  Group  A  and  it  was  found  that  in  many  cases  the  summaries 
were  not  completed  in  the  time  allotted.     Especially  was  this 

TABLE  III.      A  COMPARISON   OF  THE   TOTAL   SCORES   MADE   BY  THE 

SUMMARIZING  GROUP  (a)  AND  THE  RE-READING 

GROUP  (b)  of  grades  VI,  VII,  AND  VIII,  ON 

THE  READING  MATERIAL,  IMMIGRATION 


Grades  and  Groups 

Whole  Test 

First  Half 

Main 
Questions 

Minor 
Questions 

VI 

Group  A 

371 

300 

25 

35 

Group  B 

379 

284 

31 

29 

Group  B  excels 

hy2.1% 

VII 

Group  A  . 

457 

330 

66 

24 

Group  B 

506 

350 

72 

26 

Croup  B  excels 

by  10.7% 

VIII 

Group  A 

780 

485 

190 

49 

Group  B 

932 

614 

209 

66 

Group  B  excels 

by  19.5% 

Read  table  thus:  Group  A  of  grade  vi  made  an  aggregate  score  of  371  points 
when  the  whole  test  was  considered,  300  points  when  only  the  first  half  was  considered, 
25  points  when  only  the  main  questions  were  counted,  and  35  points  when  only  the 
minor  questions  were  counted,  etc. 
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TABLE  IV.      A   COMPARISON   OF   THE   TOTAL   SCORES   MADE   BY   THE 

SUMMARIZING  GROUP  (a)  AND  THE  RE-READING 

GROUP  (b)  OF  GRADES  VI,  VII,  AND  VIII  ON 

THE  READING  MATERIAL,  TUBERCULOSIS 


Grades  and  Gkoups 

Whole  Test 

Main 
Questions 

Minor 
Qxjestions 

VI 

Group  A 
Group  B 
Group  A  and  B  are  equal 

597 
597 

227 
234 

60 

52 

VII 
Group  A 
Group  B 
Groups  excels  by  4.3% 

622 
649 

241 
261 

61 

43 

VIII 
Group  A 
Group  B 
Group  B  excels  by  6.4% 

890 
947 

350 

378 

81 

82 

Read  table  thus:  Group  A  of  grade  vi  made  an  aggregate  score  of  597  points 
when  the  entire  test  was  considered,  227  points  when  only  the  main  questions  were 
considered,  and  60  points  when  only  the  minor  questions  were  considered,  etc. 

true  in  grades  vi  and  vii.  Therefore,  because  all  completely  sum- 
marized the  first  half  of  the  material,  a  comparison  was  made  of 
the  scores  of  the  two  groups  over  the  first  half  of  the  tests.  It 
must  be  remembered,  however,  that  such  a  comparison  gives  an 
advantage  to  Group  A  since  many  of  the  pupils  in  it  spent  the 
major  portion  of  the  thirty  minutes  on  the  first  part  of  the  article. 

Again,  some  of  the  questions  called  for  considerable  thought 
and  organization  and  consisted  of  four  or  five  parts,  while  others 
were  pure  memory  questions.  An  analysis  was  made  of  the 
answers  of  both  groups  to  these  two  types  of  questions  to  see 
whether  those  who  summarized  answered  more  of  the  reason  and 
main  questions  than  those  who  re-read  the  article,  or  more  of  the 
memory  questions. 

The  results  for  the  two  groups  on  the  three  types  of  reading 
material  are  summarized  in  Tables  II,  III,  and  IV. 

The  Delayed  Recall 
It  was  thought  that  probably  the  pupils  in  the  group  which 
summarized  would  retain  what  they  had  read  better  than  those 
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in  the  group  which  merely  re-read  the  articles.  To  see  whether 
or  not  this  was  so,  the  same  test  as  was  given  in  the  first  place  was 
given  to  both  groups  at  the  end  of  an  eight-week  period.  The 
results  are  summarized  in  the  following  tables. 

TABLE  V.     A  COMPARISON  OF  TOTAL  SCORES  OF  THE  SUMMARIZING 

GROUP  (a)  and  the  re-reading  GROUP  (b)  OF  GRADES  VI, 

VII,  AND  VIII  ON  MATERIAL,  PEANUTS 


Group 

Grade  VI 

Grade  vn 

Grade  vra 

A 
B 

201 
212 

216 
218 

373 
390 

Read  table  thus:    Group  A  in  grade  vi  made  an  aggregate  score  of  201  points 
on  the  test  on  peanuts,  grade  vn,  an  aggregate  of  216  points,  etc. 

TABLE  VI.     A  COMPARISON  OF  TOTAL  SCORES  OF  THE  SUMMARIZING 
GROUP  (a)  and  the  re-reading  GROUP  (b)  OF  GRADES  VI, 
VII,  AND  VIII  ON  MATERIAL,  IMMIGRATION 


Group 

Grade  VI 

Grade  vn 

Grade  vm 

A 
B 

92 
105 

148 
139 

354 
382 

Read  table  thus:    Group  A  in  grade  vi  made  an  aggregate  score  of  92  points  on 
the  test  on  Itomigration,  Group  A  in  grade  vn,  an  aggregate  of  148  points,  etc. 

A  careful  comparison  of  the  scores  of  Groups  A  and  B  as  pre- 
sented in  Tables  V  and  VI  shows  that  Group  B  excels  in  five  cases. 
Group  A  in  grade  vii  excels  on  the  tests  on  Immigration. 

Conclusions 
1.  The  data  presented  in  the  preceding  tables  would  seem  to 
indicate: 

a.  That  the  re-reading  of  an  article  is  a  more  economical 
method  of  study  than  the  written  paragraph  summary, 
when  each  group  studies  the  same  amount  of  time. 

b.  The  above  conclusion  is  further  substantiated  by  the 
fact  that  the  Re-reading  Group  almost  invariably  made 
higher  scores  on  the  immediate  recall  test  than  the  Sum- 
marizing Group  whether  the  results  were  compared  over 
the  entire  test,  the  first  half  of  the  test,  over  those  questions 
called  "reason"  and  "main"  questions,  or  over  those  styled 
"minor"  questions. 
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2.  A  careful  examination  of  the  pupils'  summaries  showed: 

a.  That  verbosity  in  expressing  the  main  points  char- 
acterized much  of  the  work  of  grades  vi  and  vii,  and  hence 
much  time  was  wasted. 

b.  That  much  time  was  wasted  in  grades  vi  and  vn  be- 
cause of  the  inability  of  the  pupils  to  differentiate  between 
essential  and  non-essential  points. 

3.  The  Re-reading  Group  in  grade  vm  made  higher  scores  in 
every  case  than  the  Summarizing  Group  even  though  the  sum- 
maries of  the  pupils  in  the  Summarizing  Group  were  invariably 
completed  and  of  an  excellent  quality. 

4.  Group  A  in  grade  viii  could  easily  have  excelled  had  the 
pupils  been  able  to  recall  at  the  time  of  the  test  the  main  points 
found  on  their  summarizing  forms.  Hence  it  would  seem  that  the 
Summarizing  Group  was  handicapped  by  the  method  of  summar- 
izing each  paragraph  since  the  pupils  seemed  to  have  a  large  num- 
ber of  isolated  facts  but  failed  to  see  the  relationship  and  grasp 
the  article  in  its  entirety. 

5.  Time  would  be  very  profitably  spent  in  emphasizing  com- 
prehension in  the  reading  of  all  school  material.  This  statement 
is  verified  by  an  analysis  of  the  papers  of  the  pupils.  While  the 
students  read  the  articles  on  an  average  of  three  or  four  times,  yet 
the  median  score  was  less  than  one- third  of  the  possible  score. 

6.  The  data  presented  in  Tables  V  and  VI  showing  the  results 
of  the  delayed  recall  tests  would  seem  to  indicate: 

a.  That  since  all  retained  only  a  comparatively 
smaU  number  of  the  ideas  in  the  original  material,  frequent 
reviews  would  be  advisable  as  a  part  of  the  school  routine. 

b.  That  the  written  paragraph  summary  does  not  seem 
to  be  as  eflScient  a  method  as  the  re-reading  of  an  article. 

7.  Observation  of  the  Re-reading  Group  at  work  showed  that 
after  the  pupils  had  read  the  article  a  couple  of  times,  they  ap- 
parently lost  interest  in  it.  It  is  probable  that  the  pupils  of  this 
group  could  have  read  a  longer  article — one  which  would  have 
held  their  interest  during  the  entire  period — just  as  profitably 
in  the  same  length  of  time. 


AGE  AND   GRADE  NORMS  FOR  THE  NATIONAL  IN- 
TELLIGENCE TESTS,  SCALES  A  AND  B 

Lewis  M.  Terman  and  Ethel  D.  Whitmire 

Leland  Stanford  Junior  University 

In  June,  1920,  the  National  Intelligence  Tests,  Scales  A  and  B, 
Form  1,  were  given  to  all  the  pupils  between  the  ages  of  eight  and 
fifteen  inclusive,  who  were  present  on  certain  days  in  the  public 
schools  of  Vallejo,  California,  They  were  given  by  Dr.  Terman, 
Superintendent  A.  C.  Barker,  and  four  members  of  the  school 
force  who  had  had  experience  in  giving  group  tests.  The  scoring 
and  tabulating  were  done  by  university  students  and  high-school 
seniors  who  were  paid  for  their  time.  Their  work  was  carefully 
supervised  by  Miss  Whitmire,  but  sufficient  funds  were  not  avail- 
able to  have  the  papers  scored  twice.  All  computations  were 
carefully  checked. 

In  all  cases  Scale  A  was  given  before  Scale  B.  In  about  half 
the  classes  of  grades  v  to  viii  both  scales  were  given  at  a  single 
sitting,  broken  only  by  a  rest  of  five  to  ten  minutes.  This  was 
recognized  as  undesirable  but  was  unavoidable  because  the  tests 
were  made  during  the  last  week  of  the  school  year.  In  the  other 
classes  Scale  B  followed  one  day  after  Scale  A. 

Giving  both  scales  at  a  single  sitting  does  not,  of  course,  affect 
the  norms  thus  secured  for  the  scale  given  first  (Scale  A),  nor  do  we 
believe  that  it  affected  appreciably  the  norms  for  Scale  B.  It 
could  only  do  so  by  making  the  norms  too  high  (effect  of  practice) 
or  too  low  (the  effect  of  fatigue).  In  this  case,  since  the  tests  of 
Scale  B  differ  in  kind  considerably  from  those  of  Scale  A,  fatigue 
effects  would  ordinarily  be  expected  to  outweigh  the  practice  effects. 
Whether  they  did  so  to  any  considerable  extent  can  be  answered 
by  comparing  for  each  grade  and  each  age  separately  the  ratio 
of  the  Scale  B  norm  to  the  Scale  A  norm  in  our  own  data  with  the 
corresponding  ratios  secured  at  Washington  and  Pittsburgh, 
where  in  all  cases  Scale  B  followed  Scale  A  by  one  day.  These 
ratios  are  shown  in  Tables  I  and  11.    It  will  be  seen  that  on  the 

•  The  "Age  and  Grade  Standards  (Norms)"  as  printed  in  the  Manual  of  Directions 
accompanying  the  National  Intelligence  Tests  were  "based  upon  approximately  2,000 
examinations  made  in  Washington,  D.  C,  and  2,000  made  in  Pittsburgh,  Pennsyl- 
vania." 
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whole  the  ratios  for  the  various  ages  (Table  I)  differ  but  little 
from  those  of  Washington  and  Pittsburgh/  and  that  in  those  ages 
where  the  two  eastern  cities  differ  most  from  each  other,  Vallejo 
occupies  an  intermediate  position.  The  ratio  differences  by 
grade  (Table  II)  are  more  irregular  and  comparison  is  rendered 
difficult  by  the  fact  that  the  Washington  norms  are  given  by  half 
grades.  However,  there  is  little  if  any  evidence  that  our  norms 
have  been  affected  by  the  fact  that  both  scales  were  sometimes 
given  at  the  same  sitting. 

TABLE  I.      RATIO  OF  SCALE  B  SCORES  TO  SCALE  A  SCORES, 

BY  AGESlal 


Age 

Washington 

Pittsburgh 

VaUejo 

8 

106.16 

94.32 

102.9 

9 

102.74 

95.61 

101.2 

10 

103.66 

97.92 

101.3 

11 

100.00 

99.08 

100.7 

12 

98.23 

100.00 

98.2 

13 

100.00 

100.78 

101.1 

14 

95.45 

100.00 

100.5 

15 

97.54 

98.38 

97.7 

» 

[a]  Ratios  are  multiplied  by  100.  Those  greater  than  100  indicate  that  the  Scale  B  score  was  higher  than 
the  Scale  A  score;  those  less  than  100  indicate  the  reverse. 


TABLE  II.   RATIO  OF  SCALE  B  SCORES  TO  SCALE  A  SCORES, 


BY  GRADESW 

Grade 

Washington 

Pittsburgh 

Vallejo 

IHA. 

110.34) 

94.7 

UIB 

IVA 

104.76 
105.06) 

96.48 

103.5 

IVB 

VA 

129.85 > 
101.03  ■ 

96.85 

101.5 

VB 

VIA 

100.00 
99.14) 

100.00 

99.4 

VIB 

VHA 

100.85/ 
98.47  : 

97.64 

96.2 

VIIB 

VIIIA 

97.10 
96.48) 

100.71 

98.9 

VIUB 

[a]  Ratios  are  multiplied  by  100.    Those  greater  than  100  indicate  that  the  Scale  B  score  was  higher  than 
the  Scale  A  score;  those  less  than  100  indicate  the  reverse. 
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Inasmuch  as  the  primary  purpose  in  giving  the  tests  was  to 
secure  data  for  tentative  age  norms,  effort  was  made  to  test  every 
pupil  who  had  reached  the  eighth  birthday  and  had  not  yet  be- 
come sixteen.  In  order  to  accomplish  this  all  the  pupils  in  grades 
ni  to  vni  were  tested.  Tests  were  then  given  to  all  pupils  in 
the  high  school  who  had  not  reached  the  age  of  sixteen,  and  to  all 
pupils  in  the  first  two  grades  who  were  eight  years  old  or  older. 

According  to  the  state  compulsory  school  law  in  force  at  the 
time  the  tests  were  given,  every  pupil  in  the  state  who  had  reached 
the  age  of  eight  years  and  who  was  not  yet  sixteen  should  have 
been  in  school.  Reference  to  Table  III,  however,  will  show  that 
some  selection  has  taken  place  by  the  age  of  fourteen,  and  that  by 
the  age  of  fifteen  it  is  considerable.  To  what  extent  this  is  due  to 
partial  failure  of  the  compulsory  school  law  and  to  what  extent  it 
is  due  to  the  attendance  of  pupils  in  private  and  parochial  schools, 
it  is  impossible  to  say;  nor  do  we  know  the  nature  of  the  selection 
that  has  taken  place.  However,  our  norms  for  ages  eight  to 
fourteen  inclusive  are  probably  fairly  satisfactory  for  the  city  in 
question.  Those  for  years  eight  and  nine  are  certainly  far  more 
vaUd  than  those  published  in  the  Manual  of  Directions  for  Pitts- 
burgh and  Washington,  as  the  latter  included  no  tests  below  the 
upper  half  of  the  third  grade.  Children  of  these  ages  who  are  in 
the  upper  half  of  the  third  grade  are  probably  bright  children. 
Accordingly,  the  Washington  and  Pittsburgh  scores  for  eight-  and 
nine-year-old  children  are  too  high.  On  the  other  hand,  for  ages 
above  fourteen  the  Pittsburgh  and  Washington  norms  are  quite 
worthless,  since  no  tests  were  made  above  the  eighth  grade.  Thus 
the  brighter  children  were  left  out  and  the  norms  for  these  ages 
are  too  low.  Even  the  norms  for  fourteen  from  those  cities  are 
of  questionable  value,  for  in  the  case  of  Washington  the  number 
of  pupils  at  this  age  is  only  60  percent  and  in  Pittsburgh  only  56 
percent  of  the  average  number  for  the  three  previous  years.  The 
corresponding  figure  for  Vallejo  is  79  percent.  Even  year  fifteen 
in  Vallejo  shows  a  retention  of  67  percent  as  compared  with  the 
average  for  the  ages  11,  12,  and  13. 

As  regards  social  and  economic  status  Vallejo  is  probably  not 
far  from  the  average  of  California  cities  of  similar  population, 
though  it  should  be  remembered  that  the  general  average  for 
California  is  high  as  compared  with  the  majority  of  other  states. 
The  only  important  industries  of  the  city  are  United  States  navy 
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TABLE  III.      NUMBER  OF  CASES  INCLUDED  IN  AGE  AND  GRADE 

AVERAGES 


Grade 

Washing- 

Pitts- 

Vallejo 

Age 

Washing- 

Pitts- 

VaUejo 

ton 

burgh 

ton 

burgh 

in 

159 

308 

175 
210 

8 
9 

84 
177 

14 
96 

171 

IV 

211 

200 

V 

291 

221 

228 

10 

237 

189 

172 

VI 

316 

233 

142 

11 

276 

213 

185 

vn 

264 

182 

183 

12 

280 

169 

184 

vm 

209 

196 

135 

13 

252 

182 

159 

DC 

102 
38 

14 
15 

164 
52 

105 
41 

144 

X 

119 

Total 

1,547 

1,043 

1,213 

Total 

1,522 

1,009 

1,334 

yard  activities  (largely  shipbuilding)  and  Jflour  milling.  These 
industries  have  given  the  city  a  large  proportion  of  semi-skilled 
and  skilled  labor,  chiefly  of  American  stock.  There  is  no  reason 
to  believe  that  the  proportion  either  of  unskilled  laborers  or  of  the 
professional  and  semi-professional  classes  is  abnormally  large. 
The  following  figures  show  the  nationality  classification  of  the 
18.65  percent  of  school  children  whose  parents  were  both  foreign 
born: 

Extraction  Percent 

Latin 6,71 

Teutonic 4.73 

Scandinavian 3.57 

Slavic 2.26 

Miscellaneous 1 .  38 


Total  18.65 

Children  of  foreign-born  parents  were  included  in  the  calculation 
of  norms,  as  nearly  all  such  children  were  born  in  the  United 
States. 

Tables  IV  and  V  make  possible  a  comparison  of  the  age  and 
grade  norms  of  Scale  A,  Scale  B,  and  total  of  A  and  B  for  the  three 
cities.  In  all  cases  these  norms  are  based  on  averages.  For  the 
convenience  of  those  who  prefer  to  use  medians  the  age  and  grade 
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medians  for  Vallejo  are  given  in  Table  VIII.  In  Table  IV  it  will 
be  observed  that  our  average  total  scores  for  grades  iv,  v,  and  vi 
correspond  very  closely  to  those  from  Washington,  but  that  grades 
VII  and  VIII  are  each  about  12  points  lower  than  the  corresponding 
grades  in  Washington.  A  difference  of  12  points  corresponds 
roughly  to  about  0.4  of  a  grade,  the  average  difference  from  grade 
to  grade  being  approximately  30  points. 

It  should  be  noted  that  the  tests  on  which  the  grade  averages 
were  based  were,  in  all  three  cities,  made  near  the  close  of  the 
school  year. 

# 

TABLE  IV.      GRADE  AVERAGES  FOR  WASHINGTON,  PITTSBURGH, 

AND  VALLEJO 


Washington 

Pittsburgh 

Vallejo 

Grade 

Scale 
A 

Scale 
B 

Total 

Scale 
A 

Scale 
B 

Total 

Scale 
A 

Scale 
B 

Total 

niA 

51.2 
71.9 

48.5 
74.4 

lUB 

58 
63 
79 

64 
66 

83 

122 
129} 
162  i 

100 

IVA 
IVB 

85 

82 

167 

146 

VA 
VB 

67 
97 

87 
98 

174: 
195  i 

95 

92 

187 

89.4 

90.7 

180 

VIA 
VIB 

104 
116 

104 
115 

208  . 
231) 

112 

112 

224 

107.9 

107.2 

215 

vnA 
vnB 

118 
131 

119 
129 

237 
260) 

127 

124 

251 

120.8 

116.0 

237 

vniA 
vmB 

138 
142 

134 

137 

272^ 
279) 

140 

141 

281 

132.7 

131.3 

264 

No  comparison  of  age  averages  need  be  made  except  for  the 
years  10  to  13,  as  the  Washington  and  Pittsburgh  norms  are  mis- 
leading and  worthless  below  10  and  above  13.  For  the  years  10 
to  13  the  Vallejo  norms  are  below  those  of  Washington  by  15,  16, 
11,  and  4  points,  respectively,  and  for  the  same  four  years  they  are 
below  those  of  Pittsburgh  by  38,  35,  13,  and  23  points.  That  is, 
the  Vallejo  norms  for  these  four  ages  average  nearly  a  year  below 
those  of  Pittsburgh. 
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TABLE  V.      AGE    AVERAGES    FOR    WASHINGTON,    PITTSBURGH,    AND 

VALLEJO 


Washington 

Pittsburgh 

Vaixejo 

Age 

Scale 
A 

Scale 
B 

Total 

Scale 
A 

Scale 
B 

Total 

Scale 
A 

Scale 
B 

Total 

8 

65 

69 

134 

88 

83 

171 

34.6 

35.6 

70 

9 

73 

75 

148 

91 

87 

178 

57.1 

57.8 

115 

10 

82 

85 

167 

96 

94 

190 

75.7 

76.7 

152 

11 

98 

98 

196 

108 

107 

215 

89.6 

90.2 

180 

12 

113 

111 

224 

113 

113 

226 

107.4 

105.5 

213 

13 

119 

119 

238 

128 

129 

257 

116.3 

117.6 

234 

14 

132 

126 

258 

130 

130 

260 

133.3 

133.9 

267 

IS 

122 

119 

241 

123 

121 

244 

137.0 

133.8 

271 

TABLE  VI.   GRADE  INCREMENTS  IN  TOTAL  SCORES  OF  SCALES  A 

AND  B 


Grades 

Washington 

Pittsburgh 

Vallejo 

IV  to      V 

V  to    VI 

VI  to  vn 

vn  to  vm 

36 
36 
29 
17 

20 
37 
27 
30 

34 
35 
22 
27 

Average 

29 

28.5 

29.5 

TABLE  VII.   AGE  INCREMENTS  IN  TOTAL  SCORES  OF  SCALES  A  AND  B 


Ages 

Washington 

Pittsburgh 

Vallejo 

8  to  9 

+14 

+  8 

+45 

9  to  10 

+19 

+12 

+37 

10  to  11 

+29 

+25 

+28 

11  to  12 

+28 

+11 

+33 

12  to  13 

+14 

+31 

+21 

13  to  14 

+20 

+  3 

+33 

14  to  15 

-17 

-16 

+  4 

Average  for 

9  to  14 

22 

16.65 

30.65 
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Tables  VI  and  VII  show  the  age  and  grade  increments  in  total 
score  of  Scales  A  and  B  in  the  three  cities.  Since  the  Wa  hington 
norms  are  given  by  half  grades,  the  grade  increments  for  that  city 
are  based  upon  the  averages  for  the  upper  half  of  each  grade. 

The  grade  increments  for  all  three  cifes  suggest  that  a  year 
of  growth  ought  to  yield  an  increment  of  about  29  points.  How- 
ever, when  we  examine  the  age  increments  of  Table  VII  we  find 
that  only  those  of  Vallejo  give  results  which  agree  with  this 
assumption.  Washington  and  Pittsburgh  show  increments  at 
most  ages  which  are  considerably  less  than  this.  In  both  of  these 
cities  the  increments  are  small  in  the  lower  years,  increase  grad- 
ually until  toward  the  middle  of  the  age  range  they  approximate 
the  expected  increments,  then  decrease  in  the  higher  ages  until 
finally  the  increment  becomes  really  a  decrement  corresponding 
to  about  a  half  year  of  mental  age.  This  is,  of  course,  due  to  selec- 
tion. It  is  evident  that  at  Washington  and  Pittsburgh  only  the 
brighter  children  below  ten  years  were  tested.  On  the  other 
hand,  at  Washington  only  the  duller  children  above  twelve  and  at 
Pittsburgh  only  the  duller  children  above  thirteen  were  tested. 
At  Vallejo,  however,  the  annual  increments  from  ages  nine  to  four- 
teen approximate  those  which  would  be  expected  according  to  the 
grade  results.  Here  the  low  increment  from  fourteen  to  fifteen  is 
probably  due  in  the  main  to  the  selection  which  has  operated  with 
our  fifteen-year-olds.  The  unexpectedly  large  increment  at  Vallejo 
from  eight  to  nine  is  probably  due  to  the  fact  that  many  eight- 
year-olds  are  not  adequately  measured  by  the  scale,  perhaps  be- 
cause of  its  literacy  requirements.  This  would  tend  to  reduce  the 
average  for  year  eight  considerably  below  where  it  ought  to  be, 
and  is  an  error  which  the  median  tends  to  exaggerate  even  more 
than  does  the  average.  At  any  rate  our  comparison  of  the  age 
and  grade  increments  suggests  that  our  age  norms  for  the  years 
nine  to  fourteen  are  probably  not  far  wrong  for  the  city  in  ques- 
tion, and  that  those  of  Washington  and  Pittsburgh  are  probably 
of  little  value  except  in  the  very  middle  of  the  age  range. 

The  author  of  the  Manual  of  Directions  has  made  a  set  of 
provisional  age  norms  in  which  an  effort  has  been  made  to  allow 
for  the  factor  of  selection  in  the  upper  and  lower  ages.  The 
method  of  making  these  corrections  is  not  stated,  but  the  correc- 
tions themselves  are  shown  in  the  third  column  of  Table  VIII. 
In  the  fourth  and  fifth  columns  of  the  same  table  are  shown  the  age 
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Scope 

275 


Age  a^     9^ 

FiGueE  I  Scale  A,  Scale  B, and  Total 
of  A  and  B  by  age.  Children  from 
8  f o  9  are    classed   as  8 '/a  etc. 


\3*4. 
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averages  and  age  medians  for  Vallejo.  Until  extensive  data  are 
available  on  a  more  nearly  unselected  group,  we  believe  that  the 
age  norms  given  in  columns  4  and  5  should  be  used  in  preference 
to  the  figures  in  the  third  column,  which  are  the  tentative  norms 
recommended  in  the  Manual  of  Directions. 

TABLE  VIII.      AGE  NORMS  FOR  TOTAL  SCORE  OF  SCALES  A  AND  B 


Norms 

Aget"' 

Washington 
Average 

Pittsburgh 
Average 

Recom- 
mended in 
Manual 

Vallejo 
Average 

Vallejo 
Median 

Average 

for  Scale  A 

Alone 

/ 

2 

3 

4 

5 

6 

8.5 

134 

171 

130 

70 

60 

35 

9.5 

148 

178 

155 

115 

118 

57 

10.5 

167 

190 

180 

152 

158 

76 

11.5 

196 

215 

205 

ISO 

186 

90 

12.5 

224 

226 

225 

213 

216 

107 

13.5 

238 

257 

245 

234 

243 

116 

14.5 

258 

260 

260 

267 

268 

133 

15.5 

241 

244 

275 

271 

274 

137 

la]  In  all  cases  age  8  includes  children  from  8  to  9,  age  9  those  from  9  to  10,  etc.  Accordingly,  the  age 
standards  given  are  always  those  for  ages  8.5,9.5,  etc.  This  more  correct  notation  has  been  used  in  Table 
Vm  and  Figure  1. 


The  age  medians  for  Scale  A  and  Scale  B  are  very  nearly  equal 
at  all  ages  when  Scale  A  is  given  first.  If  a  pupil  has  taken  only 
Scale  A,  and  it  is  desired  to  estimate  what  his  probable  total  score 
would  have  been  had  he  taken  both  scales,  it  is  only  necessary  to 
multiply  the  score  on  Scale  A  by  2.  While  this  rule  is  not  ab- 
solutely accurate,  it  is  sufiiciently  so  for  all  practical  purposes. 
The  correlation  between  Scale  A  and  Scale  B  was  computed  and 
found  to  be  0.928,  Pearson. 

Figure  1  shows  graphically  the  Vallejo  age  curves  for  Scale  A 
and  Scale  B.  These  curves  are  based  upon  averages.  Within 
the  range  of  validity  (probably  9  to  14  years)  the  curve  of  each 
scale  approximates  a  straight  line.  If  it  were  not  for  the  reduced 
validity  of  the  test  below  9  years  and  the  unfavorable  selection  of 
cases  above  14,  it  is  probable  that  the  line  would  be  approximately 
straight  from  8  to  15. 


THE  VALUE  OF  A  HANDWRITING  SCALE  TO  AN  UN- 
TRAINED TEACHER 

R.  L.  Morton 
Ohio  University 

Various  investigators  have  shown  that  the  use  of  either  the 
Ayres  or  Thomdike  handwriting  scale  will  materially  reduce  the 
variation  among  judges  in  marks  assigned  to  the  same  specimens, 
and  will  also  reduce  the  variation  between  successive  markings 
made  by  the  same  individual.  This  fact  of  reduced  variability 
would  imply  increased  accuracy.  A  few  teachers,  however,  are 
consistent  in  their  ratings  of  handwriting  but  grossly  inaccurate — 
that  is,  they  consistently  mark  10,  15,  or  20  percent  above  or  be- 
low the  true  value.  This  consistent  inaccuracy  would  not  be  par- 
ticularly serious  if  it  existed  to  the  same  degree  and  in  the  same 
direction  among  all  teachers,  or  even  among  all  teachers  in  the 
same  grade  in  the  same  school  system.  This,  however,  is  not  the 
case. 

The  writer  has,  during  the  past  two  years,  gathered  data  bear- 
ing on  this  question:  Will  the  use  of  a  handwriting  scale,  among 
those  who  have  never  used  it  before,  result  in  more  accurate  grad- 
ing of  handwriting?  In  the  school  years  1918-1919  and  1919-1920, 
students  in  the  writer's  classes  in  educational  measurements 
worked  out  an  experiment  which  is  an  adaptation  of  that  suggested 
by  Thorndike  in  the  Teachers  College  Record  for  November,  1914. 

Students  first  rated  Thorndike's  fifty  specimens  (whose  true 
values  are  known)  by  the  usual  percentage  method.  They  were 
told  simply  to  rate  these  specimens  as  they  would,  or  did,  rate 
handwriting  in  their  schools;  except  for  the  fact  that  they  were  not 
to  think  of  the  writing  as  belonging  to  any  particular  grade  but 
were  to  think  of  100  percent  handwriting  as  that  which  is  perfect 
and  0  percent  handwriting  as  that  which  is  worthless,  or  possessed 
of  no  beauty  or  legibility.  The  students  were  then  supphed  with 
copies  of  the  scale.  For  over  90  percent  of  them  it  was  the  first 
time  that  they  had  ever  seen  a  scale,  while  only  four  or  five  of 
the  entire  number  had  ever  actually  used  a  scale  before.  A 
brief  explanation  of  the  scale  and  its  uses  was  given  by  the 
instructor  and  the  students  proceeded  to  rate  the  fifty  specimens 
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again,  this  time  in  terms  of  scale  units.  These  grades  were 
set  down  in  appropriate  columns  of  a  table  which  each  student 
constructed,  and  the  instructor  then  supplied  the  correct  values 
of  the  fifty  specimens  as  given  by  Thorndike,  which  were  also 
recorded. 

Scale  ratings  were  then  converted  into  percents  by  multiplying 
by  5.5  in  the  case  of  the  Thorndike  scale,  and  in  the  case  of  the 
Ayres  scale  by  first  adding  20  to  the  scale  values  and  then  multi- 
plying by  0.825.  The  deviation  of  each  score  from  the  correct 
score  was  then  computed;  these  deviations  were  added;  and  the 
sum  was  divided  by  50.  The  resultant  quotient  represented  each 
individual's  average  error  in  scoring  the  same  specimens  with  and 
without  the  scale.  To  facilitate  computation,  average  errors  were 
expressed  to  the  nearest  integer. 

During  the  year  1918-1919, 176  students  performed  this  ex- 
periment using  the  Thorndike  scale;  and  during  1919-1920, 102 
students  did  so  using  the  "Gettysburg  Edition"  of  the  Ayres 
scale.  As  will  be  described  later  44  others  performed  the  ex- 
periment under  somewhat  altered  conditions.  All  these  322 
were  students  in  the  writer's  classes  in  educational  measurements 
conducted  in  sixteen  cities  and  towns  in  southeastern  Ohio  in 
connection  with  the  work  of  the  Extension  Department  at  Ohio 
University.  Most  of  them  were  teachers  in  active  service  in  the 
grades.  A  few  were  high-school  teachers,  principals,  and  super- 
intendents.   A  total  of  31,100  ratings  were  used. 

Table  I  shows  the  distribution  of  the  average  errors  of  278  of 
these  teachers  in  both  directions.  Table  I  is  to  be  read  as  follows: 
One  teacher  made  an  average  error  of  7  percent  without  the  scale 
and  4  percent  with  it,  one  an  average  error  of  8  percent  without  a 
scale  and  4  percent  with  it,  three  an  average  error  of  9  percent 
without  a  scale  and  4  percent  with  it,  and  so  forth.  It  will  be  seen 
that  the  median  of  average  errors  without  a  scale  is  11.8  percent 
and  with  a  scale  the  median  is  reduced  to  6.8  percent.  In  other 
words,  the  mere  use  of  a  scale  among  these  278  teachers,  who  were 
almost  entirely  unacquainted  with  a  scale  and  its  use,  reduced  the 
average  error  5  percent.  Thus,  42.4  percent  of  the  error  was  elimi- 
nated when  the  scale  was  first  brought  into  use.  Note  that  the  low- 
est average  error  without  a  scale  was  6  percent.  Eight  people,  or  2.9 
percent  of  the  entire  group,  graded  with  this  degree  of  accuracy 
by  ordinary  methods.    On  the  other  hand,  121,  or  43.5  percent, 
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showed  this  or  a  greater  degree  of  accuracy  when  a  scale  was  sup- 
plied; and  this  was  in  spite  of  the  fact  that  the  scale  was  to  them 
a  new  tool,  to  the  use  of  which  they  were  not  accustomed. 

TABLE  I.     DISTRIBUTION  OF  THE  AVERAGE  ERRORS  (iN  PERCENTS) 
or  278  TEACHERS  WITH  AND  WITHOUT  A  SCALE 


Avpraerp! 

Without  a  Scale 

Total 

Error 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

Over 
20 

4 

1 

1 

3 

1 

1 

7 

,  5 

4 

2 

3 

6 

5 

3 

4 

1 

4 

3 

1 

2 

1 

39 

6 

3 

4 

8 

11 

6 

5 

7 

5 

5 

7 

5 

1 

3 

2 

3 

75 

7 

1 

3 

8 

9 

4 

4 

6 

7 

1 

7 

2 

3 

1 

2 

1 

4 

63 

8 

1 

3 

7 

5 

4 

4 

2 

4 

3 

3 

1 

2 

2 

1 

42 

9 

1 

2 

1 

3 

3 

2 

1 

2 

1 

1 

1 

2 

20 

1 

10 

1 

3 

2 

1 

1 

3 

1 

2 

14 

11 

2 

2 

1 

2 

1 

1 

2 

11 

12 

1 

1 

1 

3 

13 

1 

1 

14 

1 

1 

1 

3 

Total 

8 

12 

27 

39 

26 

18 

30 

21 

17 

26 

14 

8 

7 

6 

7 

12 

278 

Median  error  without  scale,  11.8  percent 
Median  error  with  scale,  6.8  percent 

Of  the  278  teachers,  13  or  4.7  percent  showed  a  loss  in  ac- 
curacy when  using  a  scale  for  the  first  time;  13  or  4.7  percent 
showed  no  change;  and  252  or  90.6  percent  showed  an  improve- 
ment, ranging  from  1  percent  to  28  percent.  This  condition  is 
more  clearly  stated  in  Table  II. 
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TABLE  n.      GAINS  IN  ACCURACY 

Gain 

Frequency 

Gain 

Frequency- 

(Percent) 

(Percent) 

-6 

1 

8 

is 

-5 

0 

9 

15 

-4 

0 

10 

12 

-3 

1 

11 

7 

-2 

4 

12 

7 

-1 

7 

13 

6 

0 

13 

14 

3 

1 

28 

15 

3 

2 

29 

16 

3 

3 

27 

17 

0 

4 

27 

18 

1 

5 

25 

19 

1 

6 

23 

28 

1 

7 

16 

Total 

278 

Our  data  furnish  some  evidence  on  the  much  discussed  ques- 
tion as  to  which  of  the  two  scales  is  the  more  valuable.  The  44 
teachers  (all  in  one  city)  referred  to  in  a  preceding  paragraph 
scored  only  25  of  the  50  specimens  but  scored  these  first  in  the 
percentage  fashion,  then  by  the  Thorndike  scale,  and  finally  by 
the  Ayres  scale.  The  brief  period  of  practice  with  the  Thorn- 
dike  scale  may  have  resulted  in  increased  skill  in  scale  use  and 
hence  have  given  the  teachers  some  advantage  in  using  the  Ayres 
scale.  On  the  other  hand,  since  the  work  was  all  done  at  one  sit- 
ting, fatigue  probably  offset  this  advantage.  At  any  rate,  the 
median  of  the  44  average  errors  with  the  Thorndike  scale  was 
found  to  be  6.4  percent  and  with  the  Ayres  scale,  6.3  percent. 
These  scores  are  not  included  in  the  tables. 

As  stated  above,  176  of  the  278  teachers  listed  in  Table  I  used 
the  Thorndike  scale  and  102  used  the  Ayres  scale,  "Gettysburg 
Edition."  The  median  of  the  average  errors  made  by  the  first 
group  without  a  scale  was  11.9  percent  and  with  a  scale  6.5  per- 
cent. For  the  second  group  the  corresponding  figures  were  11.7 
percent  and  7.3  percent.  These  figures  seem  to  indicate  that  un- 
trained teachers  can  do  slightly  more  accurate  work  with  the 
scale  devised  by  Thorndike. 
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Does  experience  in  teaching  make  for  increased  accuracy  in 
handwriting  grading  either  with  or  without  a  scale?  To  answer 
this  question  I  corplated  the  average  errors  without  a  scale  of  the 
176  students  in  the  1918-1919  group  with  the  number  of  years  of 
teaching  experience,  using  the  Pearson  formula.  I  found  the  value 
of  r  to  be  0.0009.  Teaching  experience  neither  increased  nor 
decreased  on  the  average,  the  accuracy  of  handwriting  grading 
without  a  scale,  i.  e.,  in  the  percentage  manner. 

To  measure  the  effect  of  experience  upon  ability  to  use  a  scale 
without  practice,  experience  in  years  was  correlated  with  average 
errors  with  a  scale.  A  positive  coefloicient  of  0.24  was  found. 
The  reader  should  bear  in  mind  that  a  positive  coefficient  here 
means  that,  so  far  as  this  group  is  typical,  the  more  experience  a 
teacher  had,  the  less  profitably  she  used  a  handwriting  scale  with- 
out practice.  In  other  words,  the  evidence  is  that  teaching  ex- 
perience does  not  increase  the  average  individual's  accuracy  in 
grading  handwriting  by  the  ordinary  percentage  method  under 
the  conditions  involved  in  the  experiment,  and  that  it  actually 
decreases  his  ability  to  use  a  scale. 


THE  SCHOOL  AS  A  SELECTIVE  AGENCY 

Average  mentality  expressed  in  the  form  of  an  intelligence 
quotient  is  100.  There  is  evidence  to  show  that  the  typical  first- 
year  high-school  pupil  has  a  mentality  of  105  and  that,  three  or 
four  years  later,  high-school  graduates  show  a  record  of  111. 
Between  graduation  from  high  school  and  entrance  to  college 
there  is  further  evidence  that  mentality  moves  up  something  like 
four  notches  to  115.  If  the  same  process  continues  in  college,  the 
median  intelligence  quotient  of  college  graduates  will  be  found 
to  be  120  or  over. 

The  school  has  not  engendered  this  ability.  Those  who  evince 
a  given  degree  of  mentality  have  it  as  a  possession  as  inherently 
as  they  have  blue  eyes  or  Roman  noses.  Unconsciously  the 
school,  year  after  year,  sifts  through  meshes  of  larger  and  larger 
size  those  who  are  relatively  less  capable,  and  retains  those  whose 
endowments  mark  them  for  intellectual  success. 

As  an  institution  devoted  to  preparing  the  young  for  more 
complete  living,  the  school  has  always  been  so  much  an  instrument 
of  selection  that  it  is  a  question  whether  those  who  receive  its  bene- 
fits are  as  much  developed  as  they  are  certified  for  the  affairs  of  life. 
The  school  not  only  trains  children  and  young  people  but  also 
attests  their  success  as  students.  Its  official  record  is  accepted  as 
evidence  of  competence.  If  those  who  have  attended  school  a 
relatively  long  time  have  greater  earning  capacities  than  those  who 
have  attended  a  shorter  time,  if  social  standing  is  powerfully  in- 
fluenced by  educational  advantages,  if  appointment  officials  and 
civil  service  commissions  give  much  weight  to  diplomas  and  de- 
grees, and  if  in  general  we  proceed  on  the  assumption  that  each 
higher  round  of  the  educational  ladder  confers  upon  those  who 
reach  it  additional  fitness  for  life,  it  is  because  those  who  have 
more  schooling  are  not  only  better  trained  but  also  more  highly 
selected. 

The  notion  that  the  school  produces  its  results  through  train- 
ing alone  is  too  naive  to  be  entertained.  It  is  true  that  we  some- 
times hear  teachers  and  other  school  officers  speak  as  if  the  suc- 

138 


Feb.  1921  EDITORIALS  139 

cess  of  their  pupils  in  after  life  were  wholly  attributable  to 
instruction.  Those  who  have  sought  to  measure  the  results  of 
teaching  have  often  been  told  to  look  for  them  ten,  twenty,  or 
thirty  years  later.  The  fact  is  that  our  students  have  certain 
endowments  long  before  they  come  under  our  influence.  We  may 
help  them  to  realize  their  possibilities,  or  we  may  hinder  them  in 
their  development;  but  we  cannot  create  capacity. 

Within  the  past  few  years  the  means  have  multiplied  by  which 
the  school  has  become  consciously  the  directive  and  selective 
agency  which  it  has  always  been  unconsciously.  Our  educational 
and  intelligence  tests  permit  us  to  ascertain  the  capacities  of 
pupils  far  more  accurately  than  ever  before.  Thus,  the  teacher 
becomes  a  guide  and  director.  He  is  still  the  trainer  of  youth  but 
he  selects  one  to  be  trained  in  this  way  and  another  in  that.  He 
is  no  longer  blind.  He  sees  the  limitations  and  the  failures  of  his 
pupils  and  he  applies  his  remedies — that  is,  he  brings  training  into 
play — where  it  will  do  the  most  good. 

Some  will  say  that  these  conceptions  are  fatalistic  and  depres- 
sing, but  the  real  question  is  not  a  question  of  fatalism  but  of  truth. 
As  to  the  teacher,  it  seems  to  us  that  his  calUng  is  likely  to  take  on 
added  importance  because  of  the  new  opportunities  which  these 
conceptions  will  bring  him.  Instead  of  prescribing  the  same 
treatment  for  all,  he  will  become  the  expert  diagnostician.  On  the 
basis  of  mental  ability  he  will  reclassify  children,  and  because  of 
their  special  abilities,  he  will  further  subdivide  them.  Promo- 
tion will  be  for  those  who  can  profit  by  advancement  rather  than 
for  those  who  have  reached  a  predetermined  standard.  The 
gifted,  the  mediocre,  and  the  dull  will  be  detected,  not  merely  for 
the  sake  of  identifying  them,  but  essentially  in  order  that  finer 
adjustments  may  be  made  and  larger  opportunities  realized.  When 
to  the  old  consecration  by  which  the  craft  has  been  distinguished 
is  added  the  new  insight  which  modern  methods  can  confer, 
teaching  will  acquire  new  dignity.  The  modern  school  as  an  in- 
stitution and  the  teacher  as  its  official  will  then  be  recognized  as 
properly  concerned  with  selecting  as  well  as  with  training. 

B.  R.  B. 

DERIVING  AND  PUBLISHING  EVALUATED  MATERIAL 

The  derivation  of  tests  involves  the  evaluation  of  the  elements 
of  which  the  tests  are  composed.    We  need  a  far  larger  body  of 
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these  evaluated  elements  than  now  exists.  Indeed,  there  is 
ground  for  believing  that  if  all  the  elements  which  are  now  used 
in  the  teaching  process  were  evaluated,  a  much  more  intelligent 
use  would  be  made  of  them.  For  example,  if  all  the  problems  in 
an  arithmetic  had  a  difficulty  rating,  it  is  clear  that  fewer  mis- 
understandings between  teachers  and  pupils  would  arise,  that 
more  reasonable  assigrmients  would  be  made,  and  that  a  more 
satisfactory  gradation  and  adaptation  of  material  to  the  needs  of 
pupils  would  be  possible. 

And  even  if  we  confine  ourselves  to  the  use  of  test  material  for 
measuring  purposes,  it  is  perfectly  evident  that  we  need  a  far 
richer  supply  of  these  fundamental  data.  This  is  especially  ap- 
parent when  we  consider  the  desirabihty  of  refining  the  existing 
tests.  For  example,  at  the  meeting  of  the  education  section  of 
the  American  Association  for  the  Advancement  of  Science  at 
Chicago  on  December  30,  Dr.  Luella  W.  Pressey  presented  an 
analysis  of  Monroe's  Silent  Reading  Tests.  Because  of  the  rela- 
tively large  number  of  exercises  in  the  several  parts  and  forms  of 
this  instrument,  she  was  able  to  devise  several  tests,  each  made  up 
of  material  of  a  similar  character — one  of  science  material,  an- 
other of  poetry,  etc.  She  reached  certain  interesting  conclusions 
as  to  the  limitations  of  a  general  reading  score  based  on  a  test  con- 
sisting of  different  sorts  of  material.  It  was  clear,  however,  that 
Dr.  Pressey  could  have  carried  her  investigation  much  further  if 
she  could  have  had  at  her  command  a  still  richer  body  of  evaluated 
exercises.  It  has  often  been  observed  that  one  of  the  tendencies 
in  the  test  movement  is  precisely  towards  this  type  of  analysis. 
In  virtue  of  it  we  shall,  no  doubt,  have  in  the  place  of  general 
reading  scales,  scales  for  narrative,  for  exposition,  for  scientific 
writing,  for  poetry,  etc.  We  already  have,  instead  of  general 
scales  for  composition  and  handwriting,  analytical  scales  involving 
the  measurement  of  special  abilities. 

Not  only  in  the  refinement  of  our  instruments  and  in  the  an- 
alysis of  the  more  general  forms  of  educational  measurement,  but 
also  in  the  repetition  of  tests  do  we  require  a  greater  volume  of 
material.  Not  infrequently  a  teacher  or  a  superintendent,  after 
having  used  all  the  available  forms  of  a  test,  desires  to  continue 
its  use  in  order  to  secure  progress  records.  Since  the  children  are 
already  familiar  with  the  existing  material,  their  subsequent  scores 
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will  represent  not  only  progress  but  also  the  learning  effect  of  the 
previous  presentations.  Since  the  latter  is  diflScult  or  impossible 
to  measure,  the  progress  record  remains  undetermined.  And  yet 
such  a  record  constitutes  an  especially  valuable  result  of  testing. 
Probably  one  of  the  most  serious  criticisms  of  the  use  which  school 
people  are  now  making  of  tests  is  that  they  do  not  continue  their 
use  long  enough  to  receive  the  full  benefit  of  them.  Yet  in  justice 
to  the  school  people,  it  should  be  said  that  a  more  continuous  use  of 
the  tests  would  doubtless  be  made  if  they  were  extended,  enriched, 
and  provided  with  more  alternative  forms — in  other  words,  if  a 
larger  body  of  evaluated  material  were  available. 

Moreover,  every  research  bureau  should  have  at  hand  a  supply 
of  standardized  words,  problems,  questions,  and  other  items  which 
it  can  utilize  in  new  combinations  and  for  special  purposes.  In- 
deed, it  seems  to  us  to  be  one  of  the  routine  duties  of  such  a  bu- 
reau annually  or  semiannually  to  gather  the  responses  of  a  large 
number  of  children  to  a  variety  of  test  elements.  Such  material 
in  the  files  of  the  bureaus  should  be  as  much  a  part  of  their  stand- 
ard equipment  as  typewriters  or  adding  machines. 

We  shall  not  attempt  to  be  exhaustive  in  pointing  out  the  uses 
that  may  be  made  of  scaled  data.  Our  purpose  is  served  if  we 
establish  the  fact  that  these  uses  are  many  and  important.  The 
lack  of  such  material  is  evident  on  every  hand.  Questions  of 
import  cannot  be  answered  without  it.  The  "best"  method  of 
teaching  a  given  subject,  the  value  of  particular  kinds  of  drill,  the 
amount  of  time  that  may  be  most  economically  spent  on  a  subject 
or  a  phase  of  a  subject,  the  distribution  of  this  time  into  long  or 
short  periods,  the  rate  at  which  material  should  be  presented,  the 
influence  of  types  of  imagery  on  methods  of  learning  and  of  teach- 
ing, the  effect  of  re-learning  or  review  and  of  the  intervals  between 
periods  of  re-learning,  the  comparative  efl&ciency  of  a  "whole 
method"  and  a  "part  method"  of  learning,  the  extent  to  which 
there  is  a  transfer  from  abilities  acquired  in  given  situations  to 
abilities  manifested  in  other  situations — these  and  almost  count- 
less numbers  of  problems  which  beset  the  paths  of  both  school 
people  and  research  workers  demand  for  their  investigation 
a  rich  and  highly  organized  body  of  calibrated  items. 

Such  being  the  case,  it  is  proper  to  inquire  how  this  sort  of  ma- 
terial can  be  produced  in  larger  volume.    Everyone  who  has  at- 
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tempted  the  evaluation  of  data  knows  that  the  process  is  tedious 
and  expensive — often  prohibitively  so  when  sufficient  returns 
are  to  be  handled  to  secure  a  relatively  high  degree  of  reliability. 

But  it  is  quite  possible  to  abridge  the  usual  method  of  evalua- 
tion and  to  ascertain  the  difficulty  of  new  material  by  utilizing 
material  whose  difficulty  has  already  been  determined.  We  do 
not  mean  that  the  results  obtained  in  this  way  will  be  as  accurate 
as  those  obtained  from  a  large  number  of  returns  on  each  item,  but 
sufficient  accuracy  may  be  secured  for  most  practical  purposes. 
Thus,  as  money  makes  money,  so  evaluated  material  may  be  used 
to  make  evaluated  material. 

We  have  tried  this  sort  of  thing  in  a  small  way.  On  a  list  of 
fifty  words  we  had  returns  from  Between  4,000  and  5,000  children 
in  the  fourth,  fifth,  and  sixth  grades. 

We  divided  the  list  into  two  equal  parts,  assuming  that  the 
first  twenty-five  words  were  of  known  difficulty  and  the  second 
twenty-five  of  unknown  difficulty.  We  then  investigated  the  re- 
turns from  a  small  city  system  in  which  there  were  about  one  hun- 
dred children  in  each  of  the  fourth,  fifth,  and  sixth  grades.  We 
found  that  on  the  first  twenty-five  words  these  children  did  better 
than  our  norms  led  us  to  expect — better  by  an  amount  which  we 
were  able  to  determine.  Now,  to  the  extent  that  the  spelling 
ability  of  this  group  of  children  was  general  and  not  merely  specific 
with  reference  to  these  words,  the  same  superiority  might  be  ex- 
pected to  be  revealed  in  the  second  half  of  the  list — i.  e.,  in  the 
undetermined  words.  Accordingly,  the  results  from  this  small 
city  on  the  undetermined  words  were  reduced  by  the  same  amount. 
Up  to  this  point  we  had  been  ignoring  the  fact  that  we  really  knew 
the  difficulty  of  the  second  half  of  the  Ust.  We  now  compared  the 
difficulty  as  obtained  from  the  three  hundred  children  with  the 
difficulty  which  we  had  previously  found.  Only  two  or  three  of 
the  words  were  displaced  as  much  as  two  columns  on  the  Ayres 
scale,  and  most  of  them  were  not  displaced  at  all.  This  result  was 
obtained  from  about  one-fifteenth  of  the  original  number  of  cases 
and  with  perhaps  one-twentieth  of  the  labor  required  to  set  up  the 
first  norms. 

A  purist  may  be  pained  at  even  this  amount  of  divergence. 
The  differences,  however,  are  surprisingly  small.  In  the  first 
place  the  Ayres  scale  has  a  certain  unreliability.  Indeed,  we 
have  reason  to  believe  that  this  unreliability  is  greater  than  has 
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been  supposed.  In  the  second  place,  our  original  determinations 
of  difficulty  for  these  fifty  words  were  also  unreliable  to  a  certain 
extent.  In  the  third  place,  scarcely  any  of  the  discrepancies 
amounted  to  more  than  half  the  average  difference  in  spelling 
ability  between  successive  grades.  We  should  not  recommend  the 
use  of  evaluations  of  this  sort  for  the  more  refined  purposes  of  meas- 
urement, but  for  most  practical  purposes  we  believe  them  to  be 
sufficiently  accurate.  If  such  is  the  case,  it  lies  within  the  re- 
sources of  almost  any  superintendent  to  evaluate  his  own  material, 
if  he  has  at  hand  a  small  amount  of  accurately  scaled  elements. 

We  believe,  therefore,  that  all  who  are  interested  in  educational 
research  should  be  busy  in  the  standardizing  of  material.  More- 
over, this  material  once  standardized  should  not  lie  in  the  files  of 
research  bureaus  nor  in  the  desks  of  school  superintendents.  It 
should  be  published.  Its  production  ought  to  be  a  cooperative 
enterprise.  In  order  that  it  may  be,  publication  is  indispensable. 
Moreover,  the  material  must  be  issued  in  such  a  form  that  others 
may  add  to  it.  Original  rather  than  derived  figures  are  necessary. 
For  example,  it  is  not  sufficient  to  print  merely  percents  correct  for 
words  or  questions.  The  number  of  children  participating  and 
the  number  of  correct  responses  must  also  be  given,  so  that  each 
of  these  figures  may  be  augmented  by  other  workers,  and  to  the 
end  that  the  derived  percents  may  become  progressively  more  re- 
liable. But  this  sort  of  pubUcation  is  expensive.  It  tends  to  run 
to  long  and  very  detailed  tables.  Such  tables,  however,  are  to  be 
regarded  as  source  material.  Like  the  population  tables  and 
financial  statistics  of  the  Federal  Census  Bureau,  they  are  funda- 
mental to  the  study  of  a  vast  number  of  questions.  Their  inde- 
pendent value  is  not  nearly  as  great  as  their  value  when  brought 
into  relation  with  other  things. 

A  reasonable  amount  of  this  sort  of  material  should  be  pre- 
sented by  the  periodicals.  The  Journal  of  Educational  Re- 
search proposes  to  do  its  part. 

B.  R.  B. 


S^ittrmfi  anil  AtatrartB 

E,  H.  Cameron,  Editor 


GuGLE,  Marie.   Modern  junior  mathematics.  New  York:  Gregg  Publishing  Company, 
1920.    3  books. 

The  junior  high  school  as  a  part  of  the  6-3-3  plan  of  school  organization  is  winning 
strong  approval  and  support  from  many  quarters.  Miss  Gugle's  attempt  to  provide 
this  new  type  of  high  school  with  suitable  modem  texts  in  mathematics  is  one  of  the 
more  successful  among  several  such  recent  ventures.  Book  One,  planned  for  the 
seventh  school  year,  covers  rapid  correct  calculation,  checks  and  short  cuts,  and 
everyday  business  arithmetic  with  the  elements  of  bookkeeping.  Book  Two,  an 
eighth-year  text,  is  given  up  to  observational  geometry  with  an  introduction  to  algebra 
through  the  formulas  arising  from  certain  measurement  problems.  It  contains  an 
appendix  on  mathematics  clubs.  Book  Three,  for  the  ninth  year,  develops  algebra 
through  simple  quadratics  in  two  unknowns;  applies  sines,  cosines,  and  tangents  to 
problems  in  heights  and  distances;  and  closes  with  a  short  introduction  to  demonstra- 
tive geometry. 

Some  noticeable  characteristics  of  these  books  are:  (l)  drill  in  rapid  accurate 
calculation  in  everyday  business  arithmetic  motivated  through  time  tests;  (2)  con- 
tinued and  well-coordinated  use  of  graphic  methods;  (3)  a  simplified  treatment  of 
percentage;  (4)  a  close  correlation  between  arithmetic  and  familiar  everyday  business 
affairs;  (S)  a  concrete  informal  and  interesting  observational  study  of  form  and  meas- 
urement which  makes  an  excellent  foundation  for  later  work  in  formal  demonstrative 
geometry  as  well  as  leading  to  formulas  introducing  in  a  natural  way  the  literal  notation 
of  algebra;  (6)  the  emphasis  of  meaning  and  reasoning  in  algebra  above  the  too  common 
stress  on  manipulative  skill  in  complicated  and  unusual  algebraic  forms;  (7)  suflScient 
economy  of  time,  through  simplification  in  algebra,  to  introduce  in  the  ninth  year 
logarithms,  the  elements  of  trigonometry,  and  some  formal  demonstrative  geometry; 
(S)  constant  aims  at  greater  reality  through  correlation  with  the  pupils'  common 
life  experiences;  (9)  an  organization  of  subject  matter  with  greater  reference  to  psy- 
chological and  pedagogical  order  than  to  abstract  logical  order;  (lO)  some  attention 
given  to  historical  setting. 

Teachers  who  are  sensitive  to  suggestions  on  ways  to  improve  high-school  mathe- 
matics, even  if  not  teaching  in  a  junior  high  school,  will  find  these  good  books  well 
worth  examining. 

Ernest  B.  Lytle 
University  of  Illinois 

Gayley,  Charles  M.,  Young,  C.  C,  and  Kurtz,  B.  P.  English  poetry:  its  principles 
and  progress.   New  York:  Macmillan  Company,  1920.   728  pp. 

This  is  a  revised  and  enlarged  edition  of  the  book  bearing  the  same  title  which 
first  appeared  in  1904.    The  editors  have  here  added  about  one  hundred  and  fifty 
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short  poems  from  later  writers,  especially  from  those  whose  work  mirrors  the  life  of 
the  twentieth  century  both  in  peace  and  at  war.  In  their  attempts  to  adapt  the  book 
more  thoroughly  to  the  needs  of  the  high-school  student,  the  editors  have  omitted  the 
former  introduction,  which  they  called  "The  Principles  of  Poetry,"  and  have  sub- 
stituted about  fifty  pages  which  they  have  styled  "An  Introduction  to  the  Study  of 
Poetry."  This  new  material,  which  presents  in  lucid  form  what  every  high-school 
student  should  know  of  that  subject,  has  been  written  by  Professor  Gayley  in  his 
usual  attractive  and  stimulating  manner.  Both  the  student  and  the  general  reader 
will  enjoy  both  the  introduction  and  the  good  poetry  that  follows. 

H.  G.  Paul 
University  of  Illinois 

Smith,  Wayne  P.  and  Jewett,  Edmund  G.    An  introduction  to  the  study  of  science. 
New  York:  Macmillan  Company,  1919.  609  pp. 

With  but  few  exceptions,  this  book  contains  an  excellent  choice  of  material. 
Commendable  features  are  the  emphasis  upon  experimentation  and  utility.  The  style 
and  general  presentation  are  not  well  adapted  to  high-school  freshmen.  They  are 
much  better  suited  to  seniors.  The  review  questions  at  the  close  of  the  various  chapters 
are  too  largely  of  the  memoriter  type  and  refer  back  too  directly  to  the  text.  Had 
many  of  them  been  omitted  and  more  suggestive  questions  been  included,  the  book 
would  have  been  materially  improved.  The  text  is  recommended  for  reference  rather 
than  for  classroom  purposes. 


Lewis  W.  Williams 


University  of  Illinois 


Trafton,  Gilbert  H.    Science  of  home  and  community.    New  York:  Macmillan 
Company,  1920.  557  pp. 

What  constitutes  the  proper  field  of  general  science?  The  author  answers  this 
question  as  follows:  "Whether  any  particular  science  or  any  particular  topic  should 
form  a  part  of  the  course  depends  on  the  number  and  value  of  the  elements  that  it 
possesses  in  common  with  the  child's  life."  His  conclusion  that  from  this  standpoint 
physics  and  hygiene  should  dominate  the  text  is  not  supported  by  any  evidence.  It 
is  doubtful  whether  the  study  of  such  topics  as  the  wireless  telegraph  and  the  airplane 
can  be  justified  by  means  of  the  above  criterion. 

In  general,  the  author  has  succeeded  in  accomplishing  the  aim  he  has  set  for 
himself.  The  idea  of  grouping  material  around  the  science  of  the  home  and  the  science 
of  the  community  seems  especially  fitting  for  his  purpose.  The  projects  outlined  for 
pupils  and  the  questions  suggested  for  class  discussion  are  well  chosen.  Teachers  of 
general  science  when  choosing  a  text  should  give  this  work  thorough  consideration. 

Lewis  W.  Williams 
University  of  Illinois 

Dewey,  Evelyn,  Child,  Emily,  and  Beardsley,  Ruml.    Methods  and  results  of 
testing  school  children.    New  York:  E,  P.  Button  and  Company,  1920.    170  pp. 

This  volume  is  a  report  of  the  use  of  various  psychological  tests  used  in  the  meas- 
urement of  certain  groups  of  children  in  New  York  City.    The  children  were  all  of 
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Jewish  parentage  and  were  selected  in  such  a  way  that  representative  groups  were 
obtained  for  each  of  the  ages  eight  to  thirteen  inclusive.  The  tests  were  given  to 
fifty  boys  and  fifty  girls  of  each  age. 

AfteiiLome  preliminary  testing  the  following  group  tests  were  selected, 
■r  Picture  Completion  Memory  for  Objects 

Healy  A  Healy  B 

Identification  of  Forms  Memory  for  Digits 

Opposites  Card  Sorting 

Cancellation  Substitution 

Cart  Construction  Narrative  Pictures 

Rossolimo  Instruction  Box 

Ball  and  Field  Steadiness 

Nail  Driving  Learning  Box 

Needle  Threading  Strength 

Problem  Box  Binet-Yerkes 

Knox  Cubes 
Exceptional  care  was  exercised  in  the  giving  of  the  tests.  The  results,  therefore, 
have  an  unusual  significance.  A  feature  of  the  report  is  the  form  in  which  the  test 
norms  are  given.  For  each  age  the  mean  and  standard  deviation,  together  with  their 
respective  probable  errors,  are  given.  For  most  of  the  tests  the  norm  is  also  given 
in  the  form  of  the  regression  equation  on  age.  By  means  of  this  equation  the  standards 
for  any  age  within  the  limitation  covered  by  the  survey  can  be  imjnediately  obtained. 
The  use  of  the  regression  equation  assumes  a  rectilinear  relation  between  the  test 
scores  and  age.  No  correlation  tables  are  given  by  means  of  which  the  validity  of  this 
assumption  can  be  judged  accurately.  In  some  cases  the  relation  of  the  means  to  the 
ages  is  such  as  to  suggest  that  the  relation  is  not  rectilinear. 

The  authors  attempted  to  select  from  the  tests  used  certain  ones  that  would 
form  what  they  call  a  "maturity  scale."  Such  a  scale  does  not  differ  in  function  from 
the  Binet  scale  or  group  intelligence  tests.  The  criterion  of  selection  of  individual 
tests  for  this  scale  is  chronological  age.  The  tests  were  chosen  which  correlated  most 
highly  with  chronological  age.  By  means  of  this  criterion  seven  tests  were  selected 
to  form  a  "maturity  scale"  for  boys  and  six  tests  were  selected  to  form  a  "maturity 
scale"  for  girls.  For  each  of  these  groups  of  tests  the  regression  equation  is  given. 
A  child's  score  on  the  maturity  scale  can  be  found  by  substituting  his  scores  on  the 
individual  tests  in  this  equation. 

In  addition  to  the  report  on  psychological  tests  brief  mention  is  made  of  a  social 
and  physical  study  of  the  same  pupils. 

The  book  does  not  appear  to  be  of  major  importance.  The  average  school  man 
will  find  little  in  it  that  is  helpful.  The  greater  portion  is  devoted  to  the  reproduction 
of  the  tests  and  to  tables  and  charts.  The  sample  statistical  treatment  of  the  data 
collected  may  well  serve  as  a  model  for  other  reports.  W.  S.  M. 

Smith,  Alice  M.    Short  plays  by  representative  authors.   New  York:  Macnullan  Com- 
pany, 1920.   318  pp. 

Twelve  plays  are  here  presented,  mostly  of  the  one-act  variety,  selected  apparently 
on  the  plan  of  introducing  the  works  of  many  nationalities.  The  majority  of  them  are 
here  exploited  for  the  first  time  in  a  collection  of  this  kind.    Nations  represented  are 
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Iceland,  Wales,  England,  India,  The  United  States,  Germany,  Ireland,  Russia,  and 
negro  America.  The  twelve  plays  run  the  gamut  of  type,  from  the  bald  realism  of  the 
Icelandic  play,  The  Hraun  Farm,  to  Stuart  Walker's  inimitable  fancy.  Six  Who  Pass 
While  the  Lentils  Boil.  Sentiment  is  provided  in  Jeannette  Marks'  The  Merry,  Merry 
Cuckoo,  in  Tagore's  The  Post  Office,  and  in  The  Shadowed  Star  by  Mary  Macmillan. 
Mastery  of  dramatic  technic  and  superlative  dramatic  movement  are  represented  by 
John  Masefield's  adaptation  of  an  old  saga  in  The  Locked  Chest  and  in  Ludwig  Fulda's 
By  Ourselves.  Pictures  of  genre  types  are  not  absent;  the  most  notable  are  Lady 
Gregory's  Spreading  the  News  and  Ridgely  Torrence's  strong  picture  of  the  American 
negro  in  The  Rider  of  Dreams. 

In  addition  to  the  catholicity  of  taste  displayed  in  choosing  and  the  variety  of 
types  given,  all  of  the  plays  in  the  collection  are  actable,  making  the  book  distinctly 
useful  to  those  who  are  interested  in  producing  good  examples  of  modem  short  plaj^. 
Since  most  of  the  plays  wUl  in  all  probability  be  new  to  those  who  encounter  this  book, 
it  will  prove  valuable  as  an  addition  to  the  growing  literature  of  the  short  play. 

C.  H.  WOOLBERT 

University  of  Illinois 


Ni^ma  Jtema  an&  Qlommuntratwna 

This  department  will  contain  news  items  regarding  research  workers 
and  their  activities.  It  will  also  serve  as  a  clearing  house  for  more  formal 
communications  on  similar  topics,  preferably  of  not  more  than  five  hundred 
words.  These  commimications  will  be  printed  over  the  signatures  of  the 
authors.  Address  all  correspondence  concerning  this  department  to  Walter 
S.  Monroe,  University  of  Illinois,  Urbana,  Illinois. 


Readers  of  the  Journal  op  Educational  Research  will  remember  the  article  by 
Director  Murray  A.  Dalman  of  the  Indianapolis  public  schools,  in  the  January  1920 
number.  In  this  article  Mr.  Dalman  showed  a  unique  use  which  he  had  made  of  test 
material.  This  material  consisted  of  a  series  of  tests  in  each  of  the 
New  Edition  of  principal  topics  in  algebra.  For  each  topic  there  was  an  exercise 
"The  Hurdles"  appropriate  to  each  of  four  levels  of  ability  among  students.  The 
editors  of  the  Journal  or  Educational  Research  have  frequently 
been  asked  how  this  test  material  could  be  obtained.  Mr.  Dalman  writes  recently  that 
he  is  making  up  a  new  edition  of  "The  Hurdles."  Doubtless  those  who  are  interested 
may  obtain  copies  of  them  from  him  at  a  nominal  charge. 

We  have  lately  received  a  copy  of  the  report  prepared  by  Miss  Clara  Mallory  on 
tests  in  silent  reading  (Monroe)  and  spelling.    This  material  shows  not  only  the 

achievement  in  these  subjects  in  1920,  but  also  a  comparison 
Reading  and  Spelling  with  achievements  in  1919.  In  both  years  the  testing  was 
at  Beaumont,  Texas       done  in  the  fall.   As  usually  happens  where  a  continuing  policy 

is  in  operation,  marked  improvement  is  shown.  For  example, 
in  spelling  Miss  Mallory  notes,  "Last  year  it  was  not  possible  to  get  results  from  the 
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third  grades,  as  they  were  not  able  to  write  the  words;  but  this  year  the  third  grades 
in  some  places  are  up  to  standard  and  some  of  them  are  above  standard."  In  connec- 
tion with  the  graphs  a  few  paragraphs  of  interpretation  are  included  in  the  report  and 
some  suggestions  to  teachers. 

On  December  16, 17,  and  18,  the  Conference  of  State  and  Parish  School  Officials 
was  held  at  New  Orleans  under  the  auspices  of  the  State  Department  of  Public  Instruc- 
_     ,  tion.    Considerable  attention  was  given  to  questions  of  educational 

__      ^  ,  research.    Indeed,  there  was  a  decided  disposition  on  the  part  of  the 

makers  of  the  program  to  give  the  entire  discussion  a  fact  basis. 
Dr.  Walter  S.  Monroe  was  the  principal  speaker  from  outside  the  state.  He  addressed 
the  conference  on  the  following  topics:  (1)  measurement  of  general  intelligence  and 
achievement  of  school  children;  (2)  standards  for  achievement  tests  and  their  use; 
(3)  objectives  in  arithmetic;  (4)  equal  educational  opportunities;  (5)  the  teaching  of 
arithmetic;  (6)  royal  roads  to  learning. 

The  Bureau  of  Educational  Measurements,  Kansas  State  Normal 
New  Tests       School,  Einporia,  Kansas,  announces  for  distribution  the  following 
new  tests:  Lunceford  Number  Test,  Kansas  Latin  Test  and  Beach 
Music  Test. 

The  following  statement  has  been  received  concerning  the  Commonwealth  Fund. 
The  directors  of  the  Commonwealth  Fund  having  become 
Educational  convinced  of  the  importance  of  encouraging  educational  research 

Research  by  the  requested  a  group  of  leading  educational  men  of  the  country  to 
Commonwealth  report  upon  the  opportunities  in  the  field  and  recommend  a  plan 
Fund  of  operation. 

This  Educational  Research  Conference  was  held  in  Atlantic 
City  on  October  23,  24,  and  25,  1920.    The  members  attending  the  conference  were: 
A.  Ross  Hill,  President,  University  of  Missouri,  Chairman 
Lotus  D.  CofEman,  President,  University  of  Minnesota 
Charles  H.  Judd,  Director,  School  of  Education,  University  of  Chicago 
Paul  Monroe,  Director,  School  of  Education,  Teachers  College,  Columbia  University 
Leonard  P.  Ayres,  Director,  Division  of  Education,  Russell  Sage  Foundation 
Samuel  P.  Capen,  Secretary,  American  Council  on  Education 
Paul  H.  Hanus,  Professor  of  Education,  Harvard  University 
Max  Farrand,  General  Director  of  the  Commonwealth  Fund 

A  gratifying  feature  of  the  conference  was  that  the  members  were  able  to  agree  so 
readily,  not  merely  upon  the  large  divisions  of  the  field,  which  were  fairly  obvious,  but 
also  in  selecting  some  of  the  most  desirable  problems  to  be  investigated  within  each 
division. 

The  conference  therefore  made  its  report,  choosing  for  its  main  subjects:  the 
problem  of  school  revenues;  the  evaluation,  analysis,  measures  and  standards  of 
accomplishment  of  school  subjects;  the  field  of  supervision;  and  the  reorganization  of 
public  school  systems.  In  each  one  of  those  larger  divisions  the  conference  chose 
a  particular  subject  by  way  of  illustration,  suggesting  how  and  by  whom  the  study  of 
that  particular  subject  might  be  advisedly  undertaken. 
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For  the  carrying  on  of  this  research,  the  conference  recommended  the  appointment 
of  a  committee  to  consider  and  recommend  projects  for  research,  and  to  assume 
executive  responsibility  for  supervising  the  carrying  on  of  such  researches  as  might 
be  adopted,  and  it  was  deemed  advisable  that  this  committee  might  also  recommend 
researches  to  be  undertaken  by  individuals  or  associations. 

The  directors  of  the  Commonwealth  Fund  accepted  this  report,  and  appointed 
the  following  committee: 

Leonard  P.  Ayres,  Vice-President,  Cleveland  Trust  Company 
Samuel  P.  Capen,  Secretary,  American  Council  on  Education,  Secretary 
Lotus  D.  Coffman,  President,  University  of  Minnesota 
Ellwood  P.  Cubberley,  Professor,  Stanford  University 
Charles  H.  Judd,  Director,  School  of  Education,  University  of  Chicago 
Paul  Monroe,  Director,  School  of  Education,  Teachers  College,  Columbia  University 
Firank  E.  Spaulding,  Professor,  Yale  University 
Max  Farrand,  General  Director,  The  Commonwealth  Fund,  Chairman  ex  officio 

Superintendent  M.  E.  Moore  of  Beaumont,  Texas,  has  recently  attempted  to 

answer  the  following  questions  by  addressing  a  questionnaire  to  the 

A  Study  of       superintendent  of  schools  in  the  class  of  cities  indicated. 

Supervision  "1.  How  many  visits  should  a  superintendent  in  a  city  of  from 

30,000  to  100,000  population  make  to  each  building  in  the  course  of 

the  year,  without  necessarily  visiting  each  room? 

"2.  How  many  visits  a  year  should  he  make  to  each  schoolroom? 

"3.  How  many  supervisors  should  the  above  named  cities  possess? 

"4.  What  supervisors?" 

Replies  were  received  from  forty  cities,  thirty-three  ranging  in  population  from 
30,000  to  100,000  and  seven  ranging  from  100,001  to  325,000. 

Twenty  of  the  answers  to  the  first  question  were  of  the  form  "as  often  as  possible," 
"no  fixed  schedule,"  "many  times,"  "no  rule."  The  median  practice  of  the  remaining 
twenty  cities  is  from  six  to  nine  visits  per  year  to  each  school  building. 

In  response  to  the  second  question  definite  replies  were  received  from  twenty-four 
cities.    The  median  practice  in  this  case  is  two  or  three  visits  to  each  schoolroom. 

Concerning  the  information  received  in  response  to  the  third  question,  Mr.  Moore 
says:  "A  glance  at  the  distribution  of  supervisors  shows  that  there  is  no  correlation 
between  the  size  of  a  city  and  the  number  of  supervisors  which  it  may  have.  For 
example,  Schenectady  with  89,000  people  has  more  supervisors  than  Kansas  City, 
Missouri  with  324,000  people;  or  St.  Joseph  with  78,000  people  has  more  supervisors 
than  Dallas  with  160,000  people;  or  Colorado  Springs  with  30,000  people  has  twice 
as  many  as  Binghampton  with  67,000  people." 

"It  is  quite  evident  from  the  data  that  a  city  reaches  what  is  considered  a  full 
corps  of  supervisors  by  the  time  it  attains  a  population  of  from  30,000  to  40,000,  and 
that  its  increase  in  supervisors  thereafter  will  in  no  sense  keep  pace  with  its  increase  in 
population." 
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Replies  were  received  from  thirty-three  of  the  forty  cities  in  regard  to  the  number 
of  supervisors.    A  summary  is  given  in  the  following  table: 


Number 

Number 

of  Supervisors 

of  Cities 

32  to  35 

1 

28  to  31 

0 

24  to  27 

0 

20  to  23 

0 

16  to  19 

3 

12  to  15 

10 

8  to  11  Median 

10 

4to   7 

9 

Oto   3 

0 

33 

Since  there  are  33  cities  or  cases,  the  median  is  the  seventeenth  case,  which  case 
lies  in  the  group  of  cities  having  from  8  to  11  supervisors;  hence  we  conclude  that 
a  range  from  8  to  11  is  the  proper  number  of  supervisors  for  a  city  of  from  30,000  to 
100,000  population. 

The  answers  to  the  fourth  question  which  were  received  from  the  33  cities  ranging 
in  population  from  30,000  to  100,000  are  siunmarized  in  the  following  table: 

Number  of 
Supervisors 

Health  (doctors  and  nurses) 87.5 

Attendance 55 

Music 50.5 

Drawing 42 .5 

Assistant    superintendent,    supervisors    of 
intermediate  grades,  and  supervisors  of 

testsand  measurements 37.5 

Physical  education 36 

Sewing 29 

Writing 24.5 

Primary  grades 20,5 


The  National  Education  Association  announces  the  ap- 
Commission  on  pointment  of  a  commission  whose  function  is  "to  coordinate  all 

Coordination  of  agencies  which  are  studying  the  problems  of  education  and  to 

Research  Agencies     work  out  a  policy  whereby  these  agencies  will  contribute  to  the 
program  advocated  by  the  Association."     This  commission 
consists  of  the  following: 

Jesse  H.  Newlon,  Superintendent  of  Schools,  Denver,  Colorado,  Chairman 
W.  C.  Bagley,  Editor-in-Chief  of  the  Journal,  Pleasantville,  N.  Y. 
hn  W.  Withers,  Dean  of  School  of  Pedagogy,  University  of  New  York,  New  York 

aty 
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J.  W.  Studebaker,  Superintendent  of  Schools,  Des  Moines,  Iowa 

Mary  D.  Bradford,  Superintendent  of  Schools,  Kenosha,  Wisconsin 

Walter  A.  Jessup,  President,  State  University  of  Iowa,  Iowa  City,  Iowa 

L.  D.  Coffman,  President,  University  of  Minnesota,  Minneapolis,  Minnesota 

Edwin  L.  Rouse,  State  Normal  Schools,  Peru,  Nebraska 

J.  G.  Crabbe,  President,  State  Teachers'  College,  Greeley,  Colorado 

W.  W.  Theisen,  Director  of  Department  of  Reference  and  Research,  Cleveland,  Ohio 

George  Melcher,  Director  Bureau  of  Research  and  Efficiency,  Kansas  City,  Missouri 

Virgil  E.  Dickson,  Director  of  Research  and  Guidance,  Oakland,  California 

Burdette  R.  Buckingham,  Director  of  Bureau  of  Educational  Research,  University 

of  Illinois,  Urbana,  Illinois 
Thomas  H.  Briggs,  Professor  of  Secondary  Education,  Colimibia  University,  New 

York  City 
Charles  E.  Rugh,  Professor  of  Education,  University  of  California,  Berkeley,  California 
W.  F.  Russell,  Dean  of  College  of  Education,  State  University  of  Iowa,  Iowa  City,  Iowa 
Annie  Webb  Blanton,  State  Superintendent  of  Public  Instruction,  Austin,  Texas 
Jessie  E.  Colbum,  Public  School  No.  61,  New  York  City 
Phoebe  E.  Matthews,  153  Morrison  Avenue,  SomerviUe,  Massachusetts 
Robinson  G.  Jones,  Superintendent  of  Schools,  Cleveland,  Ohio 
C.  P.  Cary,  State  Superintendent  of  Schools,  Madison,  Wisconsin 
James  W.  Gowans,  Superintendent  of  Schools,  Winfield,  Kansas 
Stuart  A.  Courtis,  246  Eliot  Street,  Detroit,  Michigan 

Franklin  Bobbitt,  Professor  of  Education,  University  of  Chicago,  Chicago,  Illinois 
Frank  G.  Pickell,  Assistant  Superintendent  of  Schools,  Cleveland,  Ohio 
Albert  S.  Cook,  State  Superintendent  of  Schools,  Baltimore  Maryland 

The  letter,  a  portion  of  which  is  quoted  below,  has  so  much  interested  us  that 
we  think  our  readers  will  also  like  to  read  it.    With  reference 
to  this  letter,  a  friend  of  ours  writes,  "This  aptly  illustrates 
Educational  Research    the  song  sung  some  years  ago  by  the  Mandarin  Yen  How  in 
in  China  that  charming  musical  comedy  San  Toy 

'They  do  it  in  the  West 
So  of  course  it  must  be  best 
And  I  mean  to  introduce  it  into  China.'  " 
Mr.  Francis  P.  Jones,  who  writes  the  letter,  is  principal  of  the  Hinghwa  Normal 
School  at  Hinghwa,  Fukien,  China.    He  is  also  a  member  of  the  Fukien  Christian 
Educational  Association.    At  the  point  where  we  begin  our  quotation  from  Mr. 
Jones'  letter  he  has  just  been  speaking  of  this  association.    Continuing  he  says: 

"Before  our  meeting  at  Kuliang  this  summer,  several  missionaries  had  already 
begun  the  use  of  various  tests.  Mr.  Irving  Lacy  of  Yenping  had  translated  Starch's 
reasoning  test  in  arithmetic  and  had  results  from  several  hundred  children,  all  of  them 
in  higher  primary  schools,  i.  e.,  grades  five  to  eight.  I  had  also  given  the  Cleveland 
Survey  Arithmetic  Tests  to  all  children  in  the  six  principal  higher  primary  schools  of 
our  Hinghwa  Mission.  This  amounted  to  about  three  hundred  students.  I  may 
later  be  able  to  send  you  a  graph  or  a  detailed  statement  showing  the  results  from  this 
test  in  our  schools  here.  As  far  as  general  arithmetic  ability  is  concerned  it  shows 
our  children  to  be  approximately  one  year  behind  the  children  of  the  same  grade  in 
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American  schools.  This  difference  in  attainment  is  due  largely  to  the  diflSculty  in 
getting  good  arithmetic  teachers  in  China.  The  old  Chinese  schools  did  not  consider 
arithmetic  a  proper  part  of  the  curriculum  which  was  composed  entirely  of  classical 
literature. 

"We  are  doing  our  best  to  improve  the  quality  of  the  teaching  so  that  our  children 
may  come  up  to  the  grade  of  schools  in  America.  The  results  which  Mr.  Lacy  secured 
in  his  reasoning  tests  seem  to  show  equal  attainment  between  the  children  in  our 
schools  and  those  in  American  schools.  It  is,  however,  more  difl&cult  to  draw  a  parallel 
there  because  the  translation  of  problems  from  one  language  into  another  may  result 
in  increasing  or  decreasing  the  intrinsic  difficulty  of  the  problem. 

"At  the  meeting  of  the  Fukien  Christian  Educational  Association  at  Kuliang  this 
summer,  the  above  work  was  reported  on  and  the  Bureau  of  Educational  Research  was 
established. 

"Mr.  F.  B.  Beach  of  Foochow  has  undertaken  to  adapt  group  intelligence  tests  for 
use  in  Chinese  schools.  Mr.  Irving  Lacy  proposes  to  proceed  with  his  reasoning  tests. 
Mr.  Walter  Lacy  of  Foochow  is  working  on  geography  tests  and  measurements  and  I 
have  been  asked  to  work  on  the  problem  of  English  tests  for  higher  primary  and 
middle  or  high  school. 

"One  of  the  Professors  in  Canton  Christian  College,  H.  B.  Graybill,  has  worked 
out  a  good  dictation  test  in  English,  which  tests  understanding  of  English  and  ability 
to  write  it  correctly.  His  test  is  composed  of  a  series  of  nineteen  sentences,  beginning 
with  a  simple  sentence  like — 'I  see  a  boy,'  and  gradually  increasing  in  difficulty.  You 
will  find  a  complete  account  of  this  test  in  one  of  the  numbers  of  Educational  Review 
for  China  (October,  1919). 

"This  is  the  only  definite  information  that  I  can  give  you.  Some  of  the  higher 
government  schools  are  working  at  this  problem.  The  Government  Teachers  College 
at  Nanking,  of  which  Dr.  P.  W.  Quo  is  President,  is  I  think  working  along  several  lines. 
I  have  heard  that  tests  in  different  subjects  are  also  being  worked  out  at  other  educa- 
tional centers  such  as  Pekin  University  and  West  China  University,  but  I  am  not  able 
to  give  you  any  definite  information  about  them." 

Section  Q  of  the  American  Association  for  the  Advancement  of  Science  was  in 

session  in  Chicago  during  December  28,  29,  and  30,  1920. 

Section  Q,  A.  A.  A.  S.    The  meetmg  on  December  28  which  was  a  joint  session  with 

Section  I  (Psychology),  was  devoted  to  the  nature  of  mental 

abilities  and  their  measurement.   The  particular  topics  are  indicated  in  the  following 

program: 

The  Correlation  of  Visual  and  Color  Memory  with  Art  Ability.  Ehner  E.  Jones, 
Northwestern  University,  Evanston,  Illinois. 

The  Measurement  of  Silent  Reading.  May  Ayres  Burgess,  Russell  Sage  Founda- 
tion, New  York  City  (not  present). 

Observations  of  Eye  Movements  in  Reading.  G.  T.  Buswell,  University  of 
Chicago,  Chicago,  Illinois. 

Character  and  Conditions  of  Motor  Rhythm  as  Related  to  Handwriting  Move- 
ment.   Paul  V.  West.    University  of  Wisconsin,  Madison,  Wisconsin. 

Measurements  of  SpeUing  in  the  Virginia  Survey.  F.  S.  Breed,  University  of 
Chicago,  Chicago,  Illinois. 
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Corrective  Work  in  Reading.  Wm.  S.  Gray,  University  of  Chicago,  Chicago, 
Illinois. 

Analyzing  Industrial  Educational  Requirements.  E.  K.  Strong,  Jr.,  Carnegie 
Institute  of  Technology,  Pittsburgh,  Pennsylvania. 

The  Interpretation  and  Application  of  the  Intelligence  Quotient.  F.  N.  Freeman, 
University  of  Chicago,  Chicago,  Illinois. 

Report  on  College  Admission  Tests.  L.  L.  Thurstone,  Carnegie  Institute  of 
Technology,  Pittsburgh,  Pennsylvania. 

The  Essential  Criteria  of  Mental  and  Educational  Tests.  M.  E.  Haggerty, 
University  of  Minnesota,  Minneapolis,  Minnesota. 

Combined  Mental  and  Educational  Tests.  Rudolf  Pintner,  Ohio  State  Univer- 
sity, Columbus,  Ohio. 

A  Group  Intelligence  Scale  for  Primary  Grades.  F.  A.  Kingsbury,  University  of 
Chicago,  Chicago,  Illinois. 

The  Influence  of  Heredity,  Maturity,  and  Training  on  Scores  in  Standard  Tests. 
S.  A.  Courtis,  Detroit  Public  Schools,  Detroit,  Michigan. 

One's  estimate  of  any  program  depends  largely  upon  his  personal  interests.  Thus 
in  attempting  to  note  the  high  points  one  doubtless  reflects  as  much  of  his  own  personal 
interests  as  of  the  inherent  nature  of  the  numbers  on  the  program.  The  following 
reports,  however,  appeared  to  stand  out  as  distinctive. 

Dean  Gray  reported  in  detail  a  case  study  of  a  fourth-grade  pupil  who  was  found 
to  be  extremely  deficient  in  reading.  His  report  together  with  other  reports  indicates 
that  practically  all  failures  in  reading,  except  when  due  to  a  lack  of  native  intelligence, 
can  be  eliminated  by  providing  proper  instruction  for  the  pupils.  The  correction  of 
reading  defects,  however,  requires  a  careful  study  of  the  needs  of  the  individual  pupils 
and  the  provision  of  appropriate  remedial  instruction. 

Professor  Freeman  presented  data  to  show  that  there  was  considerable  doubt 
whether  the  assumption  that  tiie  I.  Q.  is  constant  is  justified  when  it  is  based  upon 
mental  age  as  measured  by  group  intelligence  tests. 

Dean  Haggerty  presented  four  criteria  for  judging  mental  and  educational  tests: 
(1)  discrimination — a  satisfactory  test  must  show  differences  in  ability  where  real 
differences  in  ability  exist;  (2)  reliability — a  second  application  of  a  test  should  yield 
measures  which  closely  approximate  the  measures  obtained  from  the  first  application; 
(3)  significance — the  traits  measured  should  be  significant,  i.  e.,  they  should  be  included 
in  the  educational  objectives;  (4)  standards — tests  should  be  standardized  both  with 
respect  to  age  (chronological)  and  school  grade.  Our  present  grade  standards  are 
inadequate.  In  the  discussion  which  followed  Dr.  Thurstone  suggested  that  the  first 
three  of  these  criteria  might  be  included  under  the  head  of  "validity"  and  that  this 
characteristic  of  a  test  could  be  studied  directly  by  correlating  the  measures  yielded 
by  it  with  an  independent  criterion  of  the  trait  covered  by  the  test.  This  comment 
doubtless  grew  out  of  Dr.  Thurstone's  work  with  tests  for  admission  to  college  where  an 
independent  objective  measure  of  a  student's  success  is  obtainable.  In  this  case  it  is 
possible  to  study  the  validity  of  such  tests  by  directly  correlating  the  measures  yielded 
by  it  with  the  student's  future  success  in  college.  This  procedure  cannot  be  applied 
when  independent  objective  measures  are  not  available.  This  is  the  situation  with 
which  we  have  to  deal  in  the  case  of  most  tests  of  intelligence  and  school  achievement. 

Professor  Pintner  reported  a  plan  for  combining  measures  of  intelligence  and 
achievement  in  order  to  interpret  more  accurately  the  measures  of  achievement. 
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The  keynote  of  this  day's  session  as  well  as  of  the  other  sessions  was  voiced  by  the 
chairman,  Professor  Chas.  H.  Judd,  when  he  pointed  out  that  it  was  clearly  evident 
that  we  should  proceed  very  cautiously  in  interpreting  the  measures  yielded  by  our 
present  educational  tests  and  that  there  is  a  distinct  need  for  careful  and  detailed 
analysis  before  we  can  arrive  at  final  conclusions.  The  uncritical  use  of  tests  is  very 
likely  to  lead  to  erroneous  conclusions. 

On  December  29  a  joint  session  was  held  with  the  American  Psychological  Asso- 
ciation. Since  it  is  expected  that  a  separate  report  of  this  meeting  will  be  published 
in  these  columns  it  will  be  omitted  from  this  account. 

The  program  of  Thursday  morning,  December  30,  consisted  of  five  papers. 
The  first,  by  Professor  B.  R.  Buckingham,  was  on  a  "Brief  Method  of  Evaluating  Test 
Material."  Recognizing  the  need  of  a  greater  volume  of  such  material  and  the  diffi- 
culty of  evaluating  it  by  the  direct  method,  the  speaker  considered  the  possibility  of 
utilizing  data  already  in  hand  to  standardize  educational  material.  It  was  an  attempt 
to  short-circuit  the  usual  procedure  and  to  investigate  the  results  of  an  indirect  method. 
He  found  that  by  combining  twenty-five  spelling  words  of  undetermined  difficulty 
with  twenty-five  whose  difficulty  was  known  he  could  determine  the  difficulty  of  the 
new  words  by  using  returns  from  three  hundred  children  with  an  error  amounting  in 
no  case  to  more  than  two  columns  on  the  Ajnres  scale,  and  in  most  cases  to  less  than 
one  column. 

Dr.  Carter  Alexander,  Assistant  State  Superintendent,  State  Department  of 
Public  Instruction  of  Wisconsin,  set  forth  in  a  paper  "Motives  Successfully  Utilized  in 
Publicity"  some  of  the  social  and  psychological  principles  which  ought  to  be  observed 
in  such  appeals  to  the  people.  Dr.  Alexander  particularly  depricated  the  appeal  to 
pity.  He  gave  instances  in  which  emotional  cartoons  and  stories  depicting  the  sad 
condition  of  the  teacher  entirely  failed  to  produce  the  desired  effect. 

Although  Dr.  W.  Randolph  Burgess'  paper  was  entitled  "Teacher  Preparation 
in  Ten  States,"  he  had  secured  coniparable  data  for  fourteen  states.  The  percent  of 
college  and  normal-school  graduates  among  the  teaching  forces  in  these  states  was 
taken  as  the  index  for  teacher  preparation.  The  states  in  order  in  regard  to  the  pro- 
portion of  trained  teachers  were:  Massachusetts,  Rhode  Island,  New  Jersey,  Connecti- 
cut, New  Hampshire,  Colorado,  Minnesota,  Montana,  Wisconsin,  Illinois,  Virginia, 
North  Dakota,  West  Virginia,  and  Kansas.  The  percent  of  teachers  who  were  not 
graduates  of  either  college  or  normal  schools  ranged  from  fifteen  for  Massachusetts  to 
seventy-four  for  Kansas.  The  eastern  states  showed  high  records  and  the  southern 
and  middle  states  lower  records.  A  more  fundamental  condition,  however,  was  that 
the  training  of  teachers  was  most  extensive  in  states  where  urban  conditions  most 
largely  prevail.  An  index  number  derived  for  each  state  on  the  basis  of  the  number 
of  trained  teachers  revealed  a  correlation  between  teacher  preparation  and  the  percent 
of  urban  population  amounting  to  -fO.89.  Indeed,  as  Dr.  Burgess  pointed  out,  the 
problem  of  teacher  training  is  largely  a  rural  problem.  The  typical  city  teacher  is  a 
trained  teacher.  About  half  of  the  total  number  of  teachers  of  these  fourteen  states 
were  normal-school  or  college  graduates.  Among  the  ten  states  for  which  data  were 
available  over  a  ten-year  period,  there  was  an  increase  of  40  percent  in  the  amount  of 
teacher  preparation  between  1910  and  1920 — although  in  the  years  1919  and  1920 
little  progress  was  made.  If  present  rates  of  progress  are  continued  until  1950,  the 
states  now  having  the  best  record  will  have  an  average  of  nearly  four  years  of  college 
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or  normal  school  training  per  teacher.  The  present  average  for  the  best  states — 
Massachusetts,  Rhode  Island,  and  New  Jersey — is  two  years. 

Professor  A.  Caswell  Ellis  of  the  University  of  Texas  presented  a  paper  on  "The 
Rating  of  University  Professors."  Professor  Ellis  had  devised  by  an  amalgamation 
of  the  judgment  of  college  and  university  professors  and  students  a  score  card  for 
judging  college  teachers. 

Owing  to  unavoidable  delays,  the  paper  of  Professor  Fletcher  Harper  Swift  of  the 
University  of  Minnesota  which  was  scheduled  for  the  morning  session  was  postponed 
until  afternoon.  Professor  Swift  illustrated  his  paper  by  the  use  of  a  number  of 
especially  interesting  slides.  He  set  forth  in  considerable  detail  the  development  of 
school  expenditures  (with  emphasis  upon  the  sharp  upward  trend  of  the  curve  in 
recent  years),  the  various  sources  of  school  revenue,  the  productiveness  of  these  sources, 
and  the  relation  between  local,  county,  state,  and  federal  sources.  Professor  Swift 
expressed  the  conviction  that  in  the  present  state  of  our  educational  development 
the  only  agency  which  can  adequately  finance  the  schools  and  make  them  in  fact, 
as  they  are  in  theory,  imiversal,  democratic,  and  free,  is  the  state  government. 

On  the  afternoon  of  December  30  Professor  L.  M.  Terman  of  Leland  Stanford 
Junior  University  read  a  report  by  Dr.  Grace  Femald  on  the  teaching  of  children 
to  read  who  were  aflOicted  with  aphasia  or  word  blindness.  Several  cases  were  reported 
all  of  which  were  treated  successfully.  A  series  of  articles  on  this  topic  by  Dr.  Fer- 
nald  will  appear  soon  in  the  Joxtrnai,  op  Educational  Research. 

Professor  Bird  T.  Baldwin,  State  University  of  Iowa,  presented  data  which 
showed  that  the  anatomical  and  psychological  ages  of  children  should  receive  con- 
sideration as  well  as  chronological  and  mental  ages  in  classifying  them  for  instruction. 
A  complete  account  of  Professor  Baldwin's  work  will  appear  soon  in  book  form. 

Mr.  L.  J.  Brueckner  of  the  Detroit  public  schools  reported  on  their  method  of 
teaching  English  to  adult  foreigners.  The  essentials  of  the  method  involved  using 
material  which  had  practical  content. 

Mrs.  Luella  Pressey  of  Indiana  University  reported  a  critical  study  of  Monroe's 
Standardized  Silent  Reading  Tests.  She  found  that  when  a  test  of  this  type  was 
restricted  to  exercises  based  on  prose  paragraphs  the  correlation  of  one  test  with  a 
similar  test  was  very  high  (0.85).  For  the  same  group  of  pupils  the  correlation  with 
similar  tests  based  on  poetry  and  upon  selections  from  general  science  was  0,35  and 
0.39  respectively.  The  conclusion  suggests  that  different  abilities  are  required  for 
reading  different  types  of  material  and  that  the  validity  of  a  test  of  this  type  can  be 
greatly  increased  by  confining  the  exercises  to  a  single  type  of  reading  material. 

The  Spokane  U.  S.  History  test  was  devised  in  the  latter  part  of  the  year  1919, 
with  a  view  to  correcting  certain  defects  in  other  standardized 
Spokane  U.  S.  history  tests.  It  is  so  arranged  that  guessing  is  practically  eliminated. 
Hbtory  Test  It  is  rather  searching,  having  one  hundred  points  on  which  answers 
are  required,  and  yet  requires  an  hour  or  less  to  give.  The  scoring 
of  the  papers  is  easy  and  exact,  leaving  nothing  for  the  teacher  to  guess  at.  It  is 
fairly  complete  as  it  is  made  up  of  twenty  points  in  each  of  five  sections,  dealing 
respectively  with  dates,  people,  historic  expressions,  civic  terms  and  causes  in  their 
relation  with  historic  events. 

In  the  first  section  twenty  important  dates  are  placed  along  the  left-hand  margin 
of  the  page  and  the  twenty  historic  events  with  which  they  are  associated  are  placed 
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in  a  different  order  down  the  center  of  the  page.  On  the  right  of  the  page  is  a  vacant 
column  headed  "Date."  The  instructions  to  pupils  are,  "Select  dates  from  the  column 
on  the  left  and  write  them  in  the  vacant  column  on  the  right,  placing  each  date  opposite 
the  historic  event  associated  with  it." 

A  similar  arrangement  holds  true  of  each  of  the  other  sections.   The  second  section 
is  here  reproduced  entire  in  order  to  illustrate  the  plan. 

II 
Select  names  from  the  column  on  the  left  and  write  them  in  the  vacant  column  on 
the  right,  placing  each  name  opposite  the  historic  event  associated  with  it. 


Name 


Historic  Event 


Name 


Peary 

Sacajawea. . 

Foch 

Lincoln 

Fulton 

Dewey 

Pershing . . . 
Roosevelt.  . 

BeU 

Washington. 
Goethals. . . 
Magellan. . . 

Edison 

Grant 

Clay 

Jefferson .  . . 


Lee 

Key. . . . 
Cabot... 
Franklin . 


Destroyed  Spanish  fleet  in  Manila  Bay 

Arranged  slavery  compromises 

Invented  the  telephone 

Leading  Confederate  General 

Wrote  the  Declaration  of  Independence 

Built  the  Panama  Canal 

Discovered  North  American  Continent 

Wrote  the  "Star  Spangled  Banner" 

Invented  the  steamboat 

Guided  the  Lewis  and  Clark  Expedition 

Discovered  the  North  Pole 

Commanded  allied  armies  in  the  World  War  . . . 

Was  President  during  Civil  War 

Commanded  American  Forces  in  World  War . . . 
Was  Revolutionary  patriot,  author  and  inventor . 
Commanded  "Rough  Riders"  in  Spanish  Ameri- 
can War 

Discovered  the  Philippine  Islands 

First  president  of  the  United  States 

Leading  Union  General  in  Civil  War 

America's  most  famous  inventor 


No.  Attempted No.  Right. 


The  test  was  given  in  January  1920,  to  the  5 14  pupils  completing  the  eighth  grade 
at  the  midyear.  The  medians  for  the  28  buildings  in  which  there  were  yniA  classes 
ranged  from  59.0  to  93.5.  The  city  median  was  78.  The  quartile  medians  were  59  to 
69,  70  to  78,  78  to  82.5  and  83.5  to  93.5. 

The  boys  ranked  higher  than  the  girls  in  all  sections.  The  median  for  236  boys 
was  81  and  for  298  girls  was  74.5.  The  lowest  score  was  27  and  was  made  by  a  girl. 
The  highest  score  was  100  and  was  made  by  one  boy  and  two  girls.  Thirty-three 
pupils,  or  6.4  percent,  had  a  mark  of  50  or  less.  As  this  is  the  average  percent  of 
failure  in  the  Spokane  schools,  it  was  decided  to  call  the  passing  mark  51  or  above. 

The  results  by  ages  correspond  to  those  nearly  always  found,  namely,  that  the 
younger  pupils  in  a  class  are  the  stronger  ones.    One  pupil  eleven-years-old  received 
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a  mark  of  92.  Twelve  pupils  twelve-years-old  had  a  median  mark  of  90.  One  hundred 
four  pupils  thirteen-years-old  had  a  median  mark  of  84.5.  Two  hundred  six  pupils 
fourteen-years-old  had  a  median  of  77.  One  hundred  thirty- three  pupils  fifteen-years- 
old  had  a  median  of  76.  Forty-nine  pupils  sixteen-years-old  had  a  mark  of  71.  Seven 
pupils  seven  teen-years-old  had  a  mark  of  61.  Two  pupils  eigh  teen-years-old  had  a 
mark  of  73. 

Of  a  possible  mark  of  20  for  each  section,  the  median  marks  were  16  for  dates, 
20  for  people,  17  for  historic  terms,  16  for  civic  terms,  and  11  for  cause  and  effect.  It 
appears,  therefore,  that  associations  with  persons  are  easiest  and  those  of  cause  and 
effect  most  difficult. 

The  five  easiest  points  in  the  order  of  easiness  were  (l)  the  name  of  the  agreement 
ending  the  fighting  in  the  World  War;  (2)  the  name  of  the  first  president  of  the  United 
States;  (3)  the  date  of  the  beginning  of  the  World  War;  (4)  the  name  of  the  ship  on 
which  the  Pilgrims  came;  and  (5)  the  name  of  the  boundary  between  the  slave  and 
free  states. 

The  most  difficult  points  in  the  order  of  difficulty  were:  (l)  disputes  over  slavery 
as  causing  the  Civil  War;  (2)  the  Civil  War  as  bringing  about  national  unity;  (3)  the 
industrial  development  of  the  New  England  states  as  giving  rise  to  a  protective  tariff; 
(4)  the  lack  of  a  strong,  centralized  government  as  the  cause  of  the  critical  period; 
and  (5)  the  invention  of  the  steam  engine  and  machinery  as  the  cause  of  the  growth 
of  cities. 

In  tabulating  the  results  of  the  test  a  separate  card,  3  by  5  inches  in  size,  was 
used  for  each  pupil.  On  this  card  was  entered  the  name,  age,  sex  and  building,  to- 
gether with  the  mark  of  the  pupil  in  each  of  the  five  sections,  and  the  total.  The  use  of 
these  cards  made  possible  the  easy  segregation  of  the  results  and  finding  of  medians. 
In  the  opinion  of  the  writer  the  use  of  such  cards  is  to  be  recommended  as  a  great 
value  in  any  similar  work. 

The  use  of  the  test  seems  to  show  that  it  possesses  the  following  advantages: 

1.  Pupils  understand  what  to  do  from  reading  the  brief  instructions  given  in 
the  test  itself,  thus  making  unnecessary  any  explanation  by  the  teacher. 

2.  The  key  accompanying  the  test  makes  it  quick  and  easy  to  score,  and  elimi- 
nates any  uncertainty  as  to  the  mark  to  be  given. 

3.  It  is  our  conviction  after  using  the  test  that  it  points  unerringly  to  the  strength 
or  weakness  in  the  history  work  of  the  individual  pupil  or  class. 

4.  The  test  is  diagnostic  in  that  a  detailed  comparison  of  individual  or  class 
results  points  out  specific  weaknesses. 

Orvblle  C.  Pratt 
Superintendent  of  Schools 
Spokane,  Washington 

Superintendent  L.  W.  Keeler,  Michigan  City,  Indiana,  has  furnished  the  Bureau 
of  Educational  Research  with  data  from  which  the  coefficient  of 
Validity  of  Illinois     correlation  between  scores  yielded  by  the  Illinois  General  Intelli- 
General  Intelll-        gence  Scale  and  the  Otis  Group  Intelligence  Scale  has  been 
gence  Scale  calculated.    The  coefficient  of  correlation  for  124  pupils  in  the 

lower  sixth  grade  is  0 .  83.  For  83  pupils  in  the  upper  sixth  grade 
it  is  0.82.  The  Otis  Group  Intelligence  Scale  was  given  in  September  1920,  and  the 
Illinois  scale  about  two  months  later.    The  Otis  scale  had  previously  been  given  to 
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several  of  the  pupils  in  the  upper  sixth  grade  in  May  1920.   The  correlation  between 
these  two  sets  of  scores  for  64  pupils  was  found  to  be  0 .  76. 

These  coefficients  of  correlation  are  based  upon  I.  Q.'s  rather  than  point  scores. 
They  show  a  high  degree  of  correlation  between  the  measures  yielded  by  these  two 
instruments  for  measuring  intelligence.  This  suggests  that  the  two  scales  measure 
the  same  traits  of  pupils. 

In  the  lower  sixth  grade  the  average  I.  Q.  for  the  point  score  was  90.5.  For  the 
Illinois  scale  it  was  89.9.  In  the  upper  sixth  the  averages  were — Otis  106.2,  Illinois 
94 , 2.  These  averages  suggest  that  the  I.  Q.'s  obtained  from  the  use  of  the  Illinois  scale 
are  lower  than  the  corresponding  I.  Q.'s  for  the  Otis  Scale.  This  in  turn  means  that 
the  mental  ages  yielded  by  the  Illinois  Scale  are  lower.  Other  data  gathered  by  the 
Bureau  of  Educational  Research  indicate  that  the  mental  ages  obtained  by  the  Illinois 
scale  are  about  one  year  and  two  months  too  low.  This  estimate  is  subject  to  revision 
on  the  basis  of  additional  data  which  are  now  being  collected.  The  use  of  this  correc- 
tion will  insure  more  accurate  mental  ages.  However,  this  corrected  mental  age 
should  not  be  used  in  determining  achievement  quotients.  To  do  so  will  introduce  a 
considerable  error  in  the  quotients. 

W.  S.  Monroe 


(E.  J.  AsHBAUGH,  Secretary  and  Editor) 


Carter  Alexander,  Assistant  State  Superintendent,  Wisconsin,  reports  that  his 
research  energies  have  been  exerted  in  the  following  channels:  publicity  campaigns 
for  better  school  support,  state  aid  provisions,  and  the  formulation  of  legislation  needed 
in  Wisconsin. 

He  calls  attention  to  articles  in  the  June  Journal  or  Educational  Research; 
July,  August,  and  September  American  School  Board  Journal;  and  October  Educa- 
tional Review;  also,  the  December  School  and  Society.  He  also  announces  an  article 
to  appear  shortly  in  the  School  Revieio  and  the  Elementary  School  Journal. 


Mrs.  Margaret  S.  Brainard,  Director  of  Educational  Research,  Martins  Ferry, 
Ohio,  states  that  her  work  this  year  has  been  largely  along  the  lines  of  remedial  measures 
following  up  the  conditions  revealed  by  the  standard  tests  given  for  the  past  two  years. 
She  has  been  working  with  her  superintendent  on  a  bulletin  of  methods  and  devices 
for  teachers  of  reading  in  the  elementary  grades.  They  have  checked  over  the  school 
library  and  prepared  graded  book  lists  as  a  stimulus  toward  home  reading.  She  has 
planned  to  give  the  Thomdike  Visual  Vocabulary  Test  to  discover  the  part  played 
by  deficient  vocabularies. 

Some  intelligence  testing  has  been  done  with  both  the  Haggerty  Group  Test  and 
the  Binet  Individual.   Further  testing  with  subject-matter  and  intelligence  tests  will 
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be  made  for  the  purpose  of  classification  and  study  of  progress  of  pupils  doubly  pro- 
moted. 

She  also  reports  the  formation  of  an  Ohio  Educational  Research  Association  at 
a  meeting  held  at  the  university  in  December. 


Dean  Chas.  Fordyce,  University  of  Nebraska,  reports  the  following  items: 

1.  Group  mental  tests  were  given  to  all  students  of  Teachers  College  of  the 
university  during  the  first  semester.  Results  will  be  used  with  the  grades  given  by 
instructors  as  a  basis  of  determining  scholastic  standing. 

2.  Have  used  various  educational  tests,  Haggerty  Group  Tests  in  grades,  and 
the  Terman  Group  Tests  in  the  high  school  in  several  public  schools. 

3.  Are  giving  the  Ayres  Spelling  to  rural  schools  of  four  counties  for  the  purpose 
of  establishing  a  norm  in  their  state. 

4.  Making  a  comparative  study  of  the  Henmon,  Starch,  and  Hanus  Latin  tests 
in  four  different  public  schools. 


Miss  Mary  Bess  Henry,  Director  of  Research,  Santa  Ana,  California,  sends  the 
following: 

"The  Santa  Ana  schools  have  extended  the  classification  of  pupils  into  groups 
according  to  ability  and  application.  This  system  has  been  used  for  three  years  in 
our  sixth  grade  and  is  now  used  in  all  classes  from  the  sixth  grade  through  the  junior 
high,  and  a  few  in  the  senior  high.  The  work  expected  of  the  slowest  sections  is  quite 
different  from  that  of  the  rapid  sections.  All  children  in  the  fifth,  sixth,  seventh  and 
eighth  grades  have  been  given  two  group  tests,  Otis,  Illinois  Examination,  National 
Intelligence  or  Terman,  as  well  as  standard  tests  in  reading,  arithmetic,  spelling  and 
writing.  Trabue  has  been  given  in  many  cases  as  a  third  test.  These  records,  with 
his  school  marks,  record  of  health,  vision  and  hearing,  and  estimates  made  by  his  five 
or  six  teachers  of  inteUigence,  temperament,  dependability,  initiative,  ambition, 
neatness  and  conduct  are  sent  to  the  grade  or  school  to  which  he  is  promoted. 

"Three  special  rooms  for  atypical  children  are  maintained,  with  some  attempt 
at  grading.  Two  rooms  care  for  the  younger  children.  They  progress  in  time  to  the 
central  room,  where  one  half  the  time  is  spent  in  manual  training,  sewing,  and  cooking. 
The  usual  handwork  is  prominent  in  all  the  special  rooms.  From  the  central  room, 
the  higher  grade  cases  progress  to  the  slowest  sections  of  the  seventh  and  eighth  grades, 
where  they  have  a  differentiated  course  of  study.  These  promotions  have  a  very 
advantageous  effect  upon  the  high  grade  morons  and  borderline  cases  in  the  special 
rooms.  A  promotion  seems  to  mean  a  great  deal  more  to  them  than  we  have  been  led 
to  expect." 


Dr.  W.  A.  McCall,  Teachers  College,  Columbia,  tells  us  that  he  and  Dr.  Trabue, 
imder  the  direction  of  Dr.  Strayer,  are  in  charge  of  mental  measurement  for  the 
Baltimore  school  survey  which  is  now  in  progress.  Also  that  form  1  of  the  Thomdike- 
McCall  Reading  Scale  is  ready  for  distribution.  The  scoring  and  computation  of 
pupil  and  class  scores  have  been  very  much  simplified.  He  announces  an  article  on 
method  of  scale  construction  in  the  January  issue  of  the  Teachers  College  Record,  and 
a  forthcoming  volume  on  "How  to  Measure  in  Education"  to  be  published  by  Mac- 
millan. 
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Dr.  M.  R.  Trabue,  of  Teachers  College,  announces  the  following  lines  of  activity. 
He  is  directing  studies  of  the  different  intelligence  tests  as  to  their  relative  values  in: 

1.  Classif)dng  pupils  entering  junior  high  school. 

2.  Determining  the  character  of  pupils  eliminated  from  metropolitan  high  schools. 

3.  Placement  of  their  own  graduates. 

He  states  he  has  a  group  of  superintendents  and  principals  from  New  York,  New 
Jersey,  and  Connecticut  who  come  in  for  criticism  and  instructions  regarding  tests 
and  measurement  work  on  Saturdays. 

He  also  states  that  he  and  Dr.  McCall  have  used  the  following  pedagogical  tests, 
which  were  not  mentioned  by  Dr.  McCall,  in  the  Baltimore  Survey:  Courtis  Arith- 
metic, Ayres  Spelling,  Thomdike  Handwriting,  Hillegas  Composition  Scale. 


We  are  glad  to  announce  the  following  new  members  to  our  Association  during 
the  past  month: 

Miss  Margaret  V.  Cobb,  Secretary  of  the  Bureau  of  Mental  Tests  and  Measure- 
ments under  G.  M.  Whipple,  University  of  Michigan.  Miss  Cobb  has  an  A.B.  from 
Radcliffe  and  an  A.M.  from  Illinois.  She  has  practically  completed  her  work  for  the 
doctor's  degree  in  the  field  of  mental  testing. 

Miss  Helen  Davis,  Director  of  the  Bureau  of  Research,  Jackson,  Michigan.  A.B. 
University  of  Illinois,  with  graduate  work  in  University  of  Illinois  and  Carnegie 
Institute  of  Technology,  specializing  in  the  field  of  tests  and  measurements.  Miss 
Davis  states  the  following  program  for  the  work  of  her  Bureau:  Under  her  direction 
the  teachers  have  given  the  National  Intelligence  Tests  to  all  children  from  iiib  to  via 
inclusive.  Recommendations  for  classification  will  be  made  on  the  basis  of  these 
results.  She  is  conducting  an  intensive  course  for  kindergarten  teachers  in  the  use  of  the 
Binet-Simon  test.  Teachers  will  give  this  examination  to  all  their  pupils  before  the 
next  semester,  and  all  children  entering  the  first  grade  in  February  will  be  classified 
on  the  basis  of  mental  age.  She  has  given  about  one  hundred  Binet  examinations  for 
the  purpose  of  reclassification  of  pupils.  Next  semester  it  is  planned  to  follow  up 
work  in  the  lower  grades  and  testing  in  intermediate  and  high  schools.  Test  results  in 
grades  above  the  sixth  will  be  used  not  only  for  classification  but  for  educational  and 
vocational  guidance. 

Mr.  Osborne  Williams,  Director  of  the  Department  of  Educational  Research  and 
Vocational  Guidance,  Atlanta,  Ga.  A.M.  Transylvania  University,  with  some  grad- 
uate work  in  the  University  of  Chicago.  He  was  a  member  of  the  Psychological 
Examining  Board,  Camp  Hancock,  for  six  months  and  assistant  in  Psychological 
Service,  Walter  Reed  Hospital,  for  six  months.  At  present  the  department  is  giving 
the  Otis  and  the  National  Intelligence  tests  to  the  high-school  freshmen,  and  some 
arithmetic  and  reading  tests  in  the  upper  grades  of  the  grammar  school. 
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The  Annual  Report  of  the  Commissioner  of  Education  of 
Massachusetts  for  the  year  1920^  contains  a  tabulat"on  showing 
the  educational  qualihcations  of  teachers  in  service  in  Massa- 
chusetts schools  at  ten-year  periods  from  1875  to  1920.  The  fol- 
lowing table  quotes  selected  figures  from  the  detail  given  in  the 
report. 

TABLE    I.      EDUCATIONAL    QUALIFICATIONS    OF    TEACHERS 
IN  MASSACHUSETTS 


Year 

Percent 

Graduates  of 

Colleges(a) 

Percent 

Graduates  of 

Normal  Schools 

Total  Percent 
Graduates  of  Col- 
leges or  Normal 
Schools 

1874-75 

19.4 
29.3 
36.0 
47.5 
55.3 
69.1 

19.4 

1884^85 

29.3 

1894^95 

1904-05 

6.3 
13.7 
16.0 
16.8 

42.3 
61.3 

1913-14 

71.3 

Jan.  1920 

85.9 

(a)  Includes  some  teachers  who  held  both  college  and  nonnal-school  diplomas. 

Table  I  indicates  that  in  a  period  of  45  years  the  number  of 
trained  teachers  in  Massachusetts  schools  has  increased  from  less 
than  one-fifth  to  more  than  five-sixths  of  the  entire  force.     It  is 


1  The  first  of  two  articles  on  the  education  of  teachers  in  service  in  the  United 
States.  The  subject  of  the  second  article  will  be  "The  Rate  of  Progress  in  Teacher 
Preparation." 

^  Proof  sheets  of  portions  of  the  report  have  been  furnished  to  the  writer  through 
kindness  of  Commissioner  Payson  Smith. 
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further  notable  that  the  rate  of  improvement  during  the  war- 
disturbed  years  from  1914  to  1920  has  been  as  rapid  as  during 
any  period. 

Valuable  Unused  Figures 

The  figures  which  have  been  quoted  are  interesting,  however, 
not  simply  because  of  the  facts  which  they  reveal  but  also  because 
of  the  type  of  inquiry  which  they  represent.  During  the  past  few 
weeks  the  writer  has  been  making  a  search  through  school  reports 
to  discover  what  figures  are  available  on  the  educational  prepara- 
tion of  teachers.  The  search  revealed  the  fact  that  at  least  four- 
teen states  have  been  carrying  in  their  annual  or  biennial  school 
reports  data  to  show  how  many  of  the  teachers  in  service  are  grad- 
uates of  colleges  or  of  normal  schools.  A  number  of  other  states 
list  simply  the  normal-school  graduates  in  service.  Only  in  rare 
instances,  however,  have  the  figures  for  different  years  been 
brought  into  comparison  to  indicate  whether  or  not  there  is  im- 
provement in  the  composition  of  the  teaching  force.  In  fact  in 
very  few  of  the  reports  have  percents  been  computed  to  show  what 
proportion  of  the  teachers  are  college  or  normal  trained.  The 
United  States  Commissioner  of  Education  has  never  attempted 
to  collect  figures  as  to  the  education  of  teachers  for  his  annual  re- 
port. In  fact  the  only  comparison  between  states  in  the  matter 
of  teacher  preparation  which  the  writer  has  been  able  to  discover 
is  contained  in  the  report  of  the  Commissioner  of  Education  for 
1891-1892,  one  of  the  early  reports  of  Dr.  William  T.  Harris. 
In  a  single  table  are  brought  together  from  different  state  reports 
the  numbers  and  percents  of  normal-school  graduates  on  the 
teaching  force  in  ten  states  and  the  numbers  and  percents  of  col- 
lege graduates  teaching  in  four  states.  The  states  which  were 
represented  in  this  tabulation  showed  an  average  of  about  16  per- 
cent of  the  teachers  to  be  graduates  of  normal  schools  and  4 
percent  graduates  of  colleges,  or  a  total  of  about  20  percent  of  the 
force  graduates  of  some  institution  of  normal  or  collegiate  rank. 
The  figures  given  were  largely  for  New  England  and  north  central 
states  and  they  were,  moreover,  on  a  number  of  somewhat  differ- 
ent bases.  Since  that  time  the  number  of  states  attempting  to 
keep  some  such  record  has  more  than  doubled  and  mechanism  of 
collecting  data  has  been  greatly  improved. 
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Recent  Studies  of  Teacher  Preparation 
Recent  statistical  studies  of  teacher  preparation  have  taken 
the  form  of  cross-section  samplings  of  special  groups  of  teachers. 
Studies  made  by  Coffman,'  Thorndike/  and  the  Carnegie  Foun- 
dation,^ while  they  yielded  a  fuller  knowledge  of  the  facts  as  to 
teacher  preparation,  and  the  relationships  between  the  education, 
experience,  and  salary  of  the  teacher,  did  not  give  a  basis  for  year- 
to-year,  or  interstate  comparisons.  The  latest  study  conducted 
by  Strayer  and  Evenden  for  the  American  City  Bureau^  gives  an 
admirable  basis  for  intercity  comparisons  of  teacher  preparation, 
and  if  repeated  in  future  years  can  yield  an  index  of  municipal 
progress  in  this  important  particular.  It  does  not  give  a  basis  for 
comparisons  between  states,  or  go  back  of  the  current  year. 

In  this  article  the  writer  proposes  to  bring  together  for  useful 
comparison  the  available  facts  as  to  the  comparative  education 
of  the  teaching  force  in  fourteen  different  states.  The  first  step 
will  be  to  present  the  figures  for  these  states  and  the  second  will  be 
to  propose  a  statistical  method  for  facilitating  ready  comparisons 
between  the  records  of  different  states  and  between  the  records 
of  different  years. 

The  Greatest  Common  Denominator 
State  reports  carry  figures  for  the  educational  preparation  of 
teachers  in  diverse  forms.     The  Massachusetts  reports  of  recent 
years  give  the  following: 

1.  Graduates  of  college  and  normal  school 

2.  Graduates  of  college 

3.  Graduates  of  normal  school 

4.  Graduates  of  city-training  school 

5.  Graduates  of  secondary  school  only 

6.  Not  graduates  of  secondary  school 

This  represents  in  some  respects  the  most  complete  classification 
encountered.     Other  states  list  besides  the  graduates  the  numbers 

'  Coffman,  Lotus  D.,  The  social  composition  of  the  teaching  population,  New  York: 
Teachers  College,  Columbia  University,  1911. 

*  Thomdike,  E.  L.,  The  teaching  staff  of  secondary  schools  in  the  United  States 
(U.  S.  Bureau  of  Education  Bulletin,  1909,  No.  4). 

*  The  professional  preparation  of  teachers  for  American  public  schools.  Bulletin 
number  14,  New  York  1920. 

"  Know  and  help  your  schools.  New  York:  American  City  Bureau,  1920. 
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of  teachers  who  attended  college  or  normal  school  but  did  not 
graduate  and  still  others  distinguish  between  those  who  graduated 
from  state  normal  schools  and  those  who  graduated  from  other 
normal  schools.  One  or  two  states  have  attempted  to  classify 
teachers  by  the  number  of  years'  training  they  have  received  be- 
yond grammar  school.  As  a  rule  the  difficult  decisions  as  to  what 
should  count  as  a  year,  the  large  amounts  of  clerical  labor,  and 
the  cost  of  printing  involved  in  this  tabulation,  have  militated 
against  its  publication  from  year  to  year.  The  two  figures  com- 
mon to  the  largest  number  of  reports  were  the  figures  for  college 
g  aduates  and  normal-school  graduates  on  the  teaching  force. 

The  Graduation  Standard 

While  the  use  of  these  two  figures  is  made  necessary  by  the 
circumstances  of  the  case  they  are  about  as  satisfactory  for  the 
purposes  of  comparative  statistics  as  any  which  could  be  secured 
without  an  extended  independent  inquiry.  College  and  normal- 
school  graduation  have  come  to  be  terms  with  considerable  defi- 
niteness  of  meaning.  College  graduation  has  in  general  come  to 
mean  four  years  of  study  beyond  secondary  school.  Normal- 
school  graduation  has  been  in  the  past  a  much  less  definite  term. 
The  normal-school  course  might  extend  anywhere  from  one  to  four 
years  and  secondary-school  graduation  might  or  might  not  be  re- 
quired for  entrance  to  the  teacher- training  course.  In  the  past 
twenty  years,  however,  there  has  been  remarkable  progress  toward 
standardization.  The  recent  report  of  the  United  States  Bureau 
of  Education  on  "Statistics  of  Normal  Schools  1917-1918"  con- 
tains a  careful  tabulation  of  entrance  requirements  and  length  of 
course  in  both  state  and  private  normal  schools.  It  is  clear  from 
this  compilation  that  with  some  exceptions  normal-school  gradua- 
tion in  this  country  now  means  the  completion  of  two  years  of 
study  beyond  the  equivalent  of  a  secondary-school  course.  The 
exceptions  are  in  two  directions,  towards  a  course  shorter  than  two 
years  and  towards  a  course  longer  than  two  years.  In  general  the 
states  which  have  the  largest  numbers  of  normal-school  graduates 
tend  to  have  the  longer  courses  of  study  and  those  which  have  the 
fewest  normal-school  graduates  tend  to  have  shorter  courses. 
Therefore  in  making  a  comparison  between  states  on  the  basis  of 
normal-school  graduates  in  service  whatever  error  there  is  will  be 
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in  the  direction  of  penalizing  the  better  states  and  favoring  the 
poorer.  It  is  believed  that  the  net  result  of  this  error  is  not  large 
in  the  case  of  the  fourteen  states  under  conside  ation. 

It  will  have  to  be  conceded  at  once  that  the  two  figures  for 
numbers  of  college  graduates  and  numbers  of  normal-school  grad- 
uates do  not  tell  us  all  we  should  like  to  know  concerning  the  edu- 
cational preparation  of  teachers.  Further  information  would  be 
desirable  show'ng  the  amount  of  work  undertaken  in  normal 
school,  college,  or  university,  which  did  not  result  in  graduation. 
An  ideal  inquiry  would  reveal  for  each  teacher  the  number  of  full 
high-school,  normal-school,  col  ege,  and  university  years  com- 
pleted. Summer  school  courses,  short  courses,  and  uncompleted 
or  unsuccessful  years  would  be  turned  into  their  full-year  equiva- 
lents. Accurate  statistics  of  this  type  are,  however,  peculiarly 
difficult  to  collect  on  a  large  scale  and  over  a  term  of  years  because 
they  involve  much  labor  of  compilation  and  much  judgment  on 
the  part  of  the  persons  reporting. 

The  figures  which  are  available,  however,  do  give  us  the  most 
essential  facts  which  we  want  to  know.  College  and  normal  grad- 
uation are  two  accepted  standards  of  teacher  preparation.  The 
proportion  of  the  teaching  force  in  any  state  who  have  completed 
full  courses  of  instruction  at  normal  schools  or  colleges  is  a  real 
indication  of  the  kind  and  amount  of  training  teachers  are  receiv- 
ing. It  is  a  measure  of  the  extent  to  which  recognized  and  ac- 
cepted standards  are  being  realized. 

A  Ten-year  Period 

The  available  figures  from  different  states  have  been  tabulated 
for  a  period  of  ten  years  from  1910  to  1920.  This  period  has  been 
selected  because  of  the  scarcity  and  diminishing  reliability  of 
figures  before  that  date,  and  because  a  ten-year  period  gives  per- 
haps the  best  indication  of  current  tendencies.  The  latest  pub- 
lished state  reports  are  in  the  main  for  the  year  1917-1918.  For 
records  of  the  school  terms  of  1918-1919  and  1919-1920  the 
writer  is  indebted  to  the  chief  school  officers  of  the  different  states, 
who  have  been  good  enough  to  furnish  data  in  advance  of  publi- 
cation. In  several  instances  the  figures  for  1920  had  not  yet  been 
tabulated.  The  state  school  officers  also  checked  through  the 
figures  for  their  states  in  order  to  detect  any  apparent  errors. 
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Fourteen  States  in  1918 

For  the  school  year  1917-1918,  figures  are  available  from 
fourteen  states  showing  the  total  teachers  in  service  and  the  num- 
bers of  these  who  were  graduates  of  colleges  or  of  normal  schools. 
The  data  as  they  were  taken  from  state  reports,  or  furnished  by 
state  school  officials,  are  shown  in  Table  II. 


table  II.      PREPARATION  OF  TEACHERS  IN  FOURTEEN  STATES 

1918 


State 

CoUege 
Graduates 

Normal-School 
Graduates 

Total 
Teachers 

Massachusetts(<') 

3,273 

441 

2,537 

1,037 

653 

1,425 

2,774 

867 

2,090 

5,666 

1,043 

698 

846 

2,241 

12,639 
2,055 

11,184 
4,294 
1,139 
2,359 
6,175 
1,560 
4,868 
6,871 
3,587 
1,774 
2,480 
1,957 

18,681 

Rhode  Island 

2,934 

New  Jersey 

16,689 

Connecticut(*) 

7,404 

New  Hampshire 

3,068 

Colorado 

6,926 

Minnesota 

18,768 

Montana 

5,600 

Wisconsin 

16,745 

Illinois 

34,597 
13,904 

Virginia(«) 

North  DakotaCfO 

7,712 

West  Virginia(«) 

10,978 

Kansas 

16,398 

Total 

25,591 

62,932 

180,404 

(a)  Figures  for  Boston  estimates  on  basis  of  percents  in  1920. 

(b)  1918-1919. 

(c)  Division  between  colleges  and  normal  schools  partly  estimated. 
W)  1916-1917. 

As  the  total  number  of  teachers  in  public  schools  in  the  United 
States  in  1918  was  650,000  the  180,394  teachers  listed  in  Table  II 
therefore  represent  between  one-quarter  and  one-third  of  all  of  the 
teachers  in  the  country.  The  group  is  representative  of  different 
parts  of  the  country,  although  New  England  is  somewhat  too 
heavily  weighted  and  the  southern  states  are  too  lightly  weighted. 
The  amount  of  teacher  preparation  shown  is  probably  somewhat 
greater  than  in  the  nation  as  a  whole. 

As  far  as  possible  only  day-school  teachers  have  been  included 
in  the  table,  and  administrative  officers  excluded.     As  a  rule  the 
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whole  number  of  different  teachers  rather  than  the  number  teach- 
ing at  one  time  is  given.  On  these  and  other  minor  points  differ- 
ences between  the  state  reports  have  made  entirely  similar  bases 
impossible.  It  is  probable  also  that  the  figures  from  some  of  the 
states  are  lacking  in  completeness.  It  is  believed  that  the  figures 
are  as  accurate,  however,  as  most  figures  similarly  collected. 
Percents  computed  from  Table  II  to  show  the  proportions  of  col- 
lege and  normal-school  graduates  among  the  teachers  of  the  diff- 
erent states  are  shown  in  Figure  1.  The  black  portion  of  the  bar 
for  each  state  shows  the  percent  of  the  teachers  who  are  college 
graduates,  the  cross-hatched  portion,  the  percent  who  are  normal- 
school  graduates  and  the  hollow  portion  the  percent  who  are  not 
graduates  of  either  normal  school  or  college.  Massachusetts 
leads  the  list  with  17.5  percent  of  her  teachers  college  graduates 
and  67.7  percent  normal-school  graduates.  Five  eastern  states 
make  by  far  the  best  records.  Then  follow  five  western  and  north 
central  states.  The  two  Virginias  with  North  Dakota  and  Kansas 
are  in  the  four  bottom  positions.  The  percent  of  college  graduates 
runs  from  21. 3  inNew  Hampshire  to  7. SinVirginia,  while  the  range 
of  the  normal-school  figures  is  from  70  percent  in  Rhode  Island  to 
12  percent  in  Kansas. 

College  Hot 

graduates  Normal  school  graduates     graduates 
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Figure  1.    Percent  of  teachers  in  fourteen  states  who  were  college  or  normal-school 

graduates,  1918 

If  there  were  a  total  bar  it  would  show  that  of  the  180,000 
teachers  for  whom  figures  are  available  almost  exactly  half  are 
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college  or  normal-school  graduates.  If  one  were  to  take  an  av- 
erage of  the  percents,  giving  each  state  equal  weight,  the  ratio 
would  be  higher  showing  55.5  percent  of  the  teachers  in  the  average 
state  to  be  graduated  from  college  or  normal  school. 

A  Single  Index  Number 

It  is  clearly  desirable  to  have  one  single  number  by  which  to 
express  the  amount  of  teacher  preparation  in  a  state.  There 
should  be  for  purposes  of  comparing  states,  tracing  progress  from 
year  to  year,  or  computing  correlations  a  single  measure  of  the 
diffusion  of  teacher  training  in  the  state.  For  this  purpose  it  is 
proposed  to  use  the  average  number  of  years  per  teacher  of  com- 
pleted training  beyond  high  schools.     The  figure  may  be  com- 


TABLE  III.   INDEX  NUMBERS  FOR  TEACHER  PREPARATION  IN 
FOURTEEN  STATES  IN  1918 


State 

Index  Number 

Massachusetts 

Rhode  Island 

2.054 
2.000 

New  Jerse}' 

Connecticut 

New  Hampshire 

Colorado 

1.948 
1.720 
1.588 
1.506 

Minnesota 

1.250 

Montana 

1.178 

Wisconsin 

Illinois 

North  Dakota 

1.082 
1.054 
0.820 

Virginia 

0.816 

Kansas 

West  Virginia 

0.786 
0.760 

Total  14  states 

1.266 

puted  for  any  slate  by  multiplying  the  number  of  college  gradu- 
ates by  four  and  the  number  of  normal-school  graduates  by  two, 
and  then  dividing  the  sum  of  these  two  products  by  the  total 
number  of  teachers.  The  resulting  figure  indicates  the  number  of 
years  of  higher  training  each  teacher  would  have  if  ail  the  years  of 
complete  training  were  distributed  evenly  among  them.  On  this 
basis  the  index  figures  for  fourteen  states  for  1918  are  shown  in 
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Table  III.  As  compared  with  Table  II,  shifts  take  place  in  the 
positions  of  the  four  lowest  states.  Two  of  the  states,  Massa- 
chusetts and  Rhode  Island,  have  reached  a  point  where  if  the 
years  of  completed  normal-school  or  college  courses  were  distrib- 
uted evenly  among  the  teachers,  there  would  be  two  to  each 
teacher.  In  four  states  the  average  training  is  less  than  one 
year  per  teacher.  Among  180,000  teachers  in  fourteen  states  the 
average  training  is  one  and  a  quarter  years. 

Essentially  a  Rural  Problem 

With  the  figures  in  this  simplified  form  it  is  possible  to  examine 
a  number  of  relationships  by  means  of  the  Pearson  coefficient  of 
correlation.  The  coefficients  are  given  in  Table  IV.  The  prob- 
able errors  of  these  coefficients  are  not  given,  as  they  would  be  in 
ordinary  conventional  practice.  There  are  two  reasons  for  this. 
The  first  is  that  the  number  of  cases  is  too  restricted.    The  second 

table  IV.   CORRELATIONS  BETWEEN  INDEX  NUMBERS  OF  TEyVCHER 
PREPARATION  AND  RELATED  FACTORS  IN  FOURTEEN  STATES 


Related  Factor 


Percent  of  population  which  is  urban(<»)  .  . . 

Annual  salaries  of  teachers(*) 

Percent  high-school  attendance  was  of  total 

attendance(*) 

Five   educational   elements   of  Ayres'  Index 

Number(«) 

Five  financial  elements  of  Ayres'  Index  Num 

ber(0 

Ayres  Index  Number(c) 


Coefficient  of 
Correlation 


0.89 
0.77 

0.66 

0.68 

0.34 
0.44 


(a)  Figures  from  1910  census  showing  percent  of  population  in  cities  or  towns  of  2,500  population  or 
over. 

(6)  Report  of  the  commissioner  of  education  on  the  statistics  of  state  school  systems,  1917-1918. 

(c)  Ayres,  Leonard  P.,  .4 n  index  number  for  state  scliool  sy stems.  Ntyi  York:  Russell  Sage  Foundation, 
1920. 

and  more  important  reason  is  that  these  fourteen  states  do  not 
constitute  a  random  sampling  from  a  very  much  larger  number  of 
states  whch  might  theoretically  be  brought  into  the  computations 
by  future  successive  samplings.  In  theory,  the  use  of  the  prob- 
able error  as  a  measure  for  determining  the  reliability  of  a  coeffi- 
cient of  correlation  rests  on  the  condition  that  the  data  used  are 
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a  truly  random  sampling  from  an  infinitely  great,  or  at  least  ex- 
ceedingly great  body  of  possibly  obtainable  data.  Since  there  are 
only  forty-eight  states  in  all,  and  since  the  fourteen  states  here 
used  are  a  selected  sampling  rather  than  a  random  one,  the  con- 
ditions requisite  for  utilizing  the  device  of  the  probable  error  do  not 
obtain.  The  most  notable  feature  of  Table  IV  is  the  exceptionally 
high  correlation  between  teacher  preparation  and  the  percent  of  the 
population  of  the  state  which  is  urban.  This  correlation  is  con- 
siderably higher  than  that  between  salaries  and  training.  The 
two  factors  of  inaccessibility  of  training  institutions  to  the 
country  girl,  and  unwillingness  on  the  part  of  the  trained  teacher 
to  go  to  the  country  school  are  evidently  even  stronger  influences 
than  amount  of  salary.  If  praise  or  blame  were  to  be  adminis- 
tered on  the  basis  of  the  standing  of  the  states  in  teacher  prepara- 
tion, the  close  relationship  between  a  state's  standing  in  this  re- 
spect and  the  proportion  of  its  population  who  are  in  the  cities 
should  not  be  overlooked. 

It  is  apparently  true  that  teacher  preparation  is  more  affected 
by  the  conditions  of  rural  life  than  almost  any  other  factor  of 
school  administration.  The  coefficient  of  correlation  between 
the  Ayres  Index  Number  and  the  percent  of  the  population  which 
is  urban  is  only  0.37.  Between  the  five  educational  elements  of 
the  index  number  and  the  percent  of  the  population  which  is  ur- 
ban there  is  a  much  closer  relationship,  expressed  by  the  Pearson 
coefficient  0.71.  Even  here  the  relationship  is  not  as  close  as  that 
just  noted  with  teacher  preparation. 

Further  interesting  evidence  of  the  contrast  between  city  and 
country  in  teacher  preparation  is  found  in  a  comparison  of  the 
figures  of  this  study  with  those  recently  gathered  from  359  cities 
of  8,000  or  more  population  by  the  American  City  Bureau.^  The 
comparison  is  made  in  Table  V.  In  order  to  bring  the  figures  to 
a  roughly  comparable  basis  it  has  been  assumed  that  six  or  seven 
years  of  education  beyond  elementary  school  as  recorded  in  the 
American  City  Bureau  study  is  the  equivalent  of  normal-school 
graduation  and  that  eight  or  more  years  is  the  equivalent  of  col- 
lege graduation.  The  359  cities  are  representative  of  all  parts 
of  the  United  States. 

''  Know  and  hdp  your  schools.  New  York:  American  City  Bureau,  1920. 
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TABLE  V.      PREPARATION  OF  TEACHERS  IN  CITIES 

STATES 

AND  IN 

ENTIRE 

Study 

Number 

of 
Teachers 

Percent 

College 

Graduates 

Percent 
Normal- 
School 
Graduates 

Percent 
with  Less 
Training 

Index 
Number 

359  cities  1920 

68,336 
180,394 

21.1 
14.2 

52.2 
34.9 

26.7 
50.9 

1.838 

14  states  1918 

1.266 

The  figures  for  cities  clearly  indicate  that  the  typical  city 
teacher  is  a  trained  teacher.  Nearly  three-quarters  of  those  for 
whom  the  facts  were  ascertained  were  either  college  or  normal- 
school  graduates.  These  facts  are  especially  notable  because  of 
the  extended  term  of  service  of  city  teachers.  The  present  teach- 
ing force  is  not  the  product  of  our  present  college,  normal,  and 
city- training  school  equipment;  for  the  median  teaching  experience 
of  teachers  in  these  cities  is  just  short  of  ten  years  and  30  percent 
have  taught  for  fifteen  or  more  years. 

The  fourteen  states  for  which  figures  have  been  presented 
show  on  the  average  a  population  50  percent  urban.  The  figures 
for  training  in  the  rural  districts  must,  therefore,  be  truly  low  to 
bring  the  state  records  so  much  under  the  city  records.  Unfor- 
tunately the  rural  figures  are  not  carried  separately  in  many  of 
the  states;  so  that  an  exact  comparison  is  not  possible. 

Teacher  Preparation  and  the  Ayres  Index  Number 

The  figures  of  Table  IV  indicate  that  index  numbers  for  teacher 
preparation  correlate  highly  with  the  educational  elements  of  the 
Ayres  index  number.  That  is  the  Ayres  number  while  it  does 
not  measure  teacher  preparation  directly,  does  do  so  to  a  certain 
extent  indirectly.  The  correlations  between  teacher  preparation 
and  the  five  financial  elements,  and  the  total  index  are  much  less 
high.  We  may  say  that  teacher  preparation  is  a  phase  of  school 
efficiency  which  runs  in  the  same  general  direction  as  the  various 
elements  of  the  Ayres  index  number  but  is  nevertheless  distinct 
in  its  importance  and  significance.  It  is  clear  that  figures  on 
teacher  preparation  would  be  a  valuable  addition  to  the  measures 
entering  into  the  index  number  for  state  school  systems.     This 
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is  only  another  way  of  saying  that  they  are  figures  which  might 
well  be  gathered  every  year  on  a  uniform  basis  by  the  United 
States  Bureau  of  Education. 

Summary 

1.  At  least  fourteen  states  have  published  in  their  school 
reports  figures  for  the  education  of  teachers  in  service  but  the 
records  of  different  states  have  not  heretofore  been  compared  nor 
have  computations  been  made  to  measure  the  progress  from  year 
to  year, 

2.  A  comparison  of  the  records  of  fourteen  states  for  1918  in- 
dicates that  Massachusetts  has  the  largest  percent  of  trained 
teachers.  The  eastern  states  in  general  show  high  records  and 
the  southern  and  middle  western  states  lower  records.  Of  180,000 
teachers  in  fourteen  states  practically  half  were  college  or  normal- 
school  graduates. 

3.  From  data  for  college  and  normal-school  graduates  in 
teaching  service  it  is  possible  to  compute  for  any  state  a  single 
index  number  for  teacher  preparation  for  any  year. 

4.  Coefficients  of  correlation  between  index  numbers  for 
teacher  preparation  and  other  related  factors  indicate  that  more 
widespread  teacher  preparation  is  predominantly  a  rural  problem. 
The  states  which  have  the  largest  rural  populations  have  the  most 
poorly  trained  teachers. 

5.  Figures  on  teacher  preparation  could  with  profit  be  added 
to  the  reports  compiled  by  the  United  States  Bureau  of  Educa- 
tion, and  would,  if  they  were  accurately  compiled,  be  a  desirable 
addition  to  the  data  entering  into  the  Ayres  index  number  for 
state  school  systems. 


MANUAL  ARTS  BASED  ON  HOME  REPAIR 

Logan   R.   Fuller 

District   Vocational  Officer,  Federal  Board  for   Vocational  Education, 

New  Orleans,  Louisiana 

This  study  was  undertaken  to  determine  what  problems  and 
processes  would  be  involved  in  a  manual  arts  course,  based  upon 
work  which  is  done  or  may  be  done  around  the  home  by  a  handy 
man  with  a  common  carpenter's  and  painter's  tools.  The  prob- 
lems of  investigation  were:  first,  to  discover  the  jobs;  second,  to 
list  and  classify  them;  and  third,  to  determine  what  processes  were 
involved. 

The  Jobs 

The  method  of  procedure  in  the  investigation  was  as  follows: 

1.  By  personal  interviews  with  fifty  people,  I  made  a  prelim- 
inary list  of  the  things  which  they  in  their  own  experience  had  had 
to  do  or  have  done  about  the  house.  These  people  consisted  of 
housewives  of  Columbia,  Missouri,  school  teachers  from  various 
sections  of  the  state  who  were  attending  summer  school,  real  es- 
tate and  rental  men  of  Columbia,  and  business  men.  In  conduct- 
ing these  interviews  I  explained  what  I  wanted  and  asked  the 
people  to  take  twenty  or  thirty  minutes  to  go  into  the  matter  in 
detail.  At  first  I  helped  a  little  by  asking  if  this  or  that  had  ever 
needed  repairing  and  usually  they  took  great  pains  to  recall  every- 
thing. When  we  had  gone  as  far  as  we  could,  I  asked  specifically 
about  other  things  which  was  mentioned  previously  by  some  one. 

2.  I  supplemented  these  interviews  by  personal  inspection  of 
twelve  houses — in  many  cases  the  dwellings  of  the  people  I  had 
interviewed.  Using  a  list  of  two  hundred  items,  I  made  a  com- 
plete survey,  in  a  small  rural  community  of  Missouri,  of  the  prob- 
lems of  household  construction  and  repair.  In  this  way  I  reached 
the  point  where  additional  inspection  or  additional  conversation 
added  only  an  occasional  item  to  the  list. 

3.  All  the  items  were  then  grouped  under  general  headings 
of  painting,  furniture  repair,  house  repair  in  general,  house  repair 
inside,  doors,  windows,  screens,  general  repair,  shoe  repair,  sharp- 
ening, plumbing  and  metal  work,  and  new  things  made  for  the 
house.  In  all  there  were  328  items.  These  were  printed  with 
the  following  directions.^  ,(The  first  section  in  painting  is  also  in- 
cluded to  show  the  form  used.) 
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DIRECTIONS 

Name City Date 

Have  you  had  any  work  in  Manual  Training? 

Our  purpose 

To  find  out  what  has  to  be  done  about  the  house,  the  doing  of  which 
requires  the  use  of  tools. 
What  you  are  asked  to  do 

First:  Examine  carefully  the  following  lists  of  things  which  are 
suggested  as  possible  things  to  be  done. 

Second:  Take  the  list  and  with  the  help  of  your  parents  or  the 
landlady  examine  the  house  in  which  you  live.  Underscore  all 
things  which  need  to  be  done.  Also  underscore  all  things  which  you, 
your  parents,  or  landlady  recall  have  been  done  in  this  house  or  any 
other  house  with  which  you,  or  they,  have  been  acquainted. 

Third:  Write  in  the  blank  space  provided  allthose  things  which 
need  to  be  done  or  have  been  done,  which  are  not  found  in  this 
list.  This  is  especially  important,  as  we  wish  to  make  this  list  as 
complete  as  possible. 

Fourth:  Please  fill  this  out  tonight.     Mark  as  directed  above. 
Have  sheets  fastened  together.     Bring  them  to  your  first  class  to- 
morrow.   Lay  them  on  the  teacher's  desk  as  you  enter. 
Painting 

Paint  house,  paint  outbuildings,  paint  repairs,  paint  screens,  paint 
interior  woodwork,  paint  floor,  paint  gutter,  paint  tin  roof,  tint 
walls,  enamel  bed,  varnish  furniture,  stain  furniture,  patch  scarred 
varnish,  remove  varnish,  varnish  woodwork,  varnish  floors,  shellac 
floors,  oil  floors,  wax  floors,  clean  and  oil  furniture,  polish  furniture, 
apply  wood  filler. 

These  questionnaires  were  presented  in  person  to  the  students 
at  assemblies  in  the  Columbia  High  School,  the  University  High 
School,  and  to  the  college  students  in  the  university  shops.  In 
all  430  blanks  were  used  and  returned.  The  frequency  of  mention 
of  each  job  was  then  determined. 

Assuming  for  purposes  of  study  that  these  jobs  would  deter- 
mine the  content  of  a  manual  arts  course,  two  alternatives  pre- 
sented themselves.  First,  the  course  might  be  taught  as  a  project 
or  home-project  course,  and  the  students  might  be  given  the  jobs 
to  do  at  home  or  in  the  shop.  Or,  second,  the  tool  processes  neces- 
sary to  perform  these  jobs  might  be  drawn  ofif  the  jobs  and  the 
tool  processes  might  be  taught  systematically  or  by  the  problem 
method.  Of  these  two  the  second  alternative  was  selected;  and  a 
type  of  analysis  is  shown  in  Table  II. 
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TABLE  I.   THE  54  JOBS  WITH  A  FREQUENCY  OF  MENTION  OF  150 
OR  OVER.   CLASSIFIED  ACCORDING  TO  TYPE  OF  JOB 


Rank 

Fre- 
quency 

Job 

Rank 

Fre- 
quency 

Job 

Painting 

Put  handle  in  tools 

1 

271 

Paint  house 

36 

169 

Rake 

5 

222 

Paint  floors 

39 

163 

Hammer 

7 

219 

Paint  screens 

41 

161 

Ax 

9 

211 

Paint  outbuildings 

50 

152 

Hatchet 

13 

197 

Paint  interior  woodwork 

11 

208 

Varnish  furniture 

Sharpen  tools 

43 

157 

Varnish  woodwork 

2 

253 

Knives 

45 

156 

Varnish  floors 

4 

224 

Scissors 

27 

183 

Pohsh  furniture 

9 

211 

Skates 

48 

154 

Clean  and  oil  furniture 

14 

195 

Ax 

31 

176 

Wax  floors 
Furniture  repair 

49 

153 

Lawn  mower 
Plumbing 

7 

219 

Tighten  screws  in  furni- 

ture 

31 

176 

Stop  leaks  in  faucets 

16 

194 

Put  knob  on  drawer 

41 

161 

Thaw  frozen  pipes 

33 

171 

Tighten  belt  on  sewing 
machine 

48 

154 

Clean  oil  stove 

36 

169 

Clean  and  adjust  sewing 

General  repair 

machine 

4 

224 

Put  up  clothes  line 

52 

151 

Reseat  chair 

11 

208 

Paper  room 

16 

194 

Mend  locks 

Screen  repair 

18 

193 

Re-putty  glass 

12 

198 

Make  fly  swatter 

20 

190 

Build  fence 

16 

194 

Put   new    wire    on    old 

20 

190 

Hang  shades 

frames 

20 

190 

Plane  tight  door 

24 

188 

Put  new  spring  on  screen 

23 

189 

Stop  rat  holes 

door 

23 

189 

Build  chicken  coop 

26 

184 

Rehang  screen  door 

26 

184 

Make  hen's  nest 

37 

167 

Put  new  hook  on  screen 

28 

182 

Fit  and  lay  linoleum 

door 

29 

177 

Make  swing 

45 

156 

Screen  in  porch 

32 

172 

Put  shelves  in  closet 

45 

156 

Hang  window  screens 

34 

170 

Make  sled 

52 

151 

Mend  torn  screen  wire 

38 

165 

Set  fence  posts 

41 

161 

Mend  window  shades 

52 

151 

Set  glass 

54 

150 

Make  yard  gate 

This  table  should  be  read  as  follows:  Painting  the  house  ranked  first  in  frequency  and  was  men- 
tioned 271  times. 

The  eleven  highest  frequencies  were:  painting  the  house  (271);  sharpening  knives  (253);  sharpening 
scissors  (224);  putting  up  clotheslines  (224);  painting  floors  (222);  painting  screens  (219);  tightening  screws 
in  furniture  (219);  painting  outbuilding  (211);  sharpening  skates  (211);  varnishing  furniture  (208);  and 
papering  rooms  (208). 
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TABLE  III.     PROCESSES  USED  IN  54  JOBS  OF  HIGHEST  FREQUENCY* 


Rank      Frequency 


Job 


Process  by  Number  (Table  II) 


1 

271 

2 

253 

4 

224 

4 

224 

5 

222 

7 

219 

7 

219 

9 

211 

9 

211 

11 

208 

11 

208 

12 

198 

13 

197 

14 

195 

16 

194 

16 

194 

16 

194 

18 

193 

20 

190 

20 

190 

20 

190 

23 

189 

23 

189 

24 

188 

26 

184 

26 

184 

27 

183 

28 

182 

29 

177 

31 

176 

31 

176 

32 

172 

33 

171 

34 

170 

36 

169 

36 

169 

37 

167 

38 

165 

39 

163 

41 

161 

41 

161 

41 

161 

43 

157 

45 

156 

45 

156 

45 

156 

48 

154 

48 

154 

49 

153 

50 

152 

52 

151 

52 

151 

52 

151 

54 

150 

Paint  house , 

Sharpen  knife 

Sharpen  scissors 

Put  up  clothes  line 

Paint  floor 

Paint  screen 

Tighten  screws  in  furniture 

Paint  outbuilding 

Sharpen  skates 

Varnish  furniture 

Paper  room 

Make  fly  swatter 

Paint  interior  woodwork 

Sharpen  ax 

Put  knob  on  drawer . . .  •. 

Put  new  screen  wire  on  frames 

Mend  locks 

Reputty  glass 

Build  fence 

Hang  shades 

Plane  tight  door 

Stop  rat  holes 

Build  chicken-coop 

Put  new  spring  on  screen  door. 

Rehang  screen  door 

Make  hens'  nest 

Polish  furniture 

Fit  and  lay  linoleum 

Make  swing 

Wax  floor 

Stop  leak  in  faucet 

Put  shelf  in  closet 

Tighten  belt  on  sewing  machine 

Make  sled 

Clean,  adjust  sewing  machine 

Put  handle  in  rake 

Put  new  hook  on  screen  door . 

Set  fence  post 

Put  handle  in  hammer 

Put  handle  in  ax 

Thaw  frozen  pipes 

Mend  window  shades 

Varnish  woodwork 

Screen  porch 

Varnish  floors 

Hang  window  screen 

Clean  oil  stove 

Clean  and  oil  furniture 

Sharpen  lawn  mower 

Put  handle  in  hatchet 

Mend  torn  screen  wire 

Reseat  chair 

Set  glass 

Make  yard  gate 


36, 37, 38, 39, 40 

30,31 

30,  31,  32 

57,  35,  9,  45,  46 

36,  37,  38,  39,  40 

36,39 

10 

36,  37,  38,  39,  40 

30,  32 

41  42  43 

51,'  52^  53,  54,  55,  56 

1,3,5,9 

36,  37,  38,  40 

30,31 

10,  57,  4 

9,  35,  57 

57,  32,  10 

48,  49 

9,  3,  45,  46,  57 

10,  57,  25 
10,  1,  25,  34 
9,57 

1,  3,  9,  28,  35 

10,57 

1,  10,  57 

1,  3,  9,  24,  28 

43 

34,2,17,24       [18,24,25,28 

1,  2,  3,  4,  5,  9,  10,  14,  16,  17, 

44,43 

10,  57,  24 

1,  2,  3,  24 

57  122,  25,  28,  24 

1,  2,  3,  4,  7,  9,  10,  13,  14,  17, 

10,57 

57,  13,  6,  24 

10,57 

45,46 

3,  6,  13,  24,  57 

3,  6,  13,  24,  57 

57 

57  9 

38i  42,  41,  43 

9,  17,  28,  57 

42 

1,3,9,  10 

57 

57,43 

30,32 

57,  13,  6,  24 

57 

9,  10,  24,  25 

47,  48,  49 

1,2,3,9,10,14,17,24,28 


(a)  In  ranking,  when 
higher  omitted;  when  three 


two  jobs  had  the  same  frequency  both  were  given  the  lower  rank,  and  the 
jobs  had  the  same  frequency  the  middle  rank  was  used 
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TABLE  rV.   FREQUENCY  OF  THE  PROCESSES  INVOLVED  IN  THE 
REPAIR  JOBS  LISTED  IN  TABLE  I 


Rank 

Job 

Fre- 
quency 

Rank 

Job 

Fre- 
quency 

1 

Planing 

10 

31 

Whetting 

3 

2 

Scoring 

5 

32 

Filing 

4 

3 

Sawing 

11 

33 

Plumbing  or  leveling 

0 

4 

Boring 

3 

34 

Scribing 

2 

5 

Sandpapering 

3 

35 

Stapling 

3 

6 

Scraping 

4 

36 

Mixing  paint 

6 

7 

Bowsawing 

1 

37 

Puttying  holes 

4 

8 

Gauging 

1 

38 

Filling 

5 

9 

Nailing 

14 

39 

Applying  paint 

5 

10 

Screwing 

15 

40 

Removing  paint 

4 

11 

Gluing 

0 

41 

Rubbing  varnish 

2 

12 

Countersinking 

0 

42 

Flowing  varnish 

3 

13 

Spokeshaving 

5 

43 

Polishing 

5 

14 

Chiseling 

3 

44 

Appljdng  wax 

1 

15 

Gouging 

0 

45 

Dig  pesthole 

3 

16 

Finishing 

1 

46 

Set  posts  in  ground 

3 

17 

Laying-out 

5 

47 

Cutting  glass 

1 

18 

Chamfering 

1 

48 

Fastening     with     glazer- 

19 

Beveling 

0 

points 

2 

20 

Modeling 

0 

49 

Appljdng  putty 

2 

21 

Carving 

0 

50 

Putting  nails,  etc. 

0 

22 

Mortising 

1 

51 

Remove  old  wall  paper 

23 

Mitering 

0 

52 

Mix  paste 

24 

Fitting 

12 

53 

Cut  paper 

25 

Superposing 

5 

54 

Apply  paste 

26 

Doweling 

0 

55 

Hang  paper 

27 

Inlaying 

0 

56 

Brush  smooth 

28 

Assembling 

6 

57 

Tinkering  (general  adjust- 

29 

.  Dadoing 

0 

ing  not    reducible    to 

30 

Grinding 

5 

processes) 

23 

In  Table  II  a  standard  is  found  for  judging  the  practical  value 
of  the  common  manual  arts  course  for  the  communities  studied. 
That  there  is  little  similarity  between  the  two  is  remarkably  clear. 
As  one  runs  over  the  list  it  is  noticeable  that  less  than  half  the 
processes  are  taught  either  as  projects  or  in  elementary  form  in 
the  present  courses.  However,  this  study  was  made  not  as  a  pro- 
test against  alleged  weaknesses  of  the  common  course  but  in  a 
spirit  of  curiosity  to  see  how  such  a  course  would  appear.     If 
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home  repair  and  construction  were  the  objective  of  the  manual 
arts  course  then  the  present  course  would  need  to  be  radically 
changed.  For  instance,  in  painting  a  house  processes  numbers 
36,  37,  38,  39,  and  40  are  used.  These  are  mixing  paint,  puttying 
holes,  filling,  applying  paint,  and  removing  paint. 

In  Table  III  are  shown  the  processes  involved  in  performing 
the  54  jobs  listed  in  Table  I.  In  order  that  all  processes  listed  be 
determined,  all  the  jobs  are  analyzed  in  terms  of  processes  not 
only  of  woodworking,  but  also  of  painting,  etc. 

When  these  have  been  derived  it  is  possible  to  determine  the 
relative  frequency  of  each  process.  This  has  been  done  in  Table 
IV,  which  shows  that  planing  occurs  ten  times  in  the  54  jobs. 
Upon  such  a  basis  it  would  be  possible  to  determine  the  more  or 
less  commonly  used  processes  so  that  relative  emphasis  might  be 
determined.  It  should  be  noted  that  the  first  31  processes  are 
those  commonly  taught  in  school  shops.  The  remainder  are  not 
usually  found  in  any  manual  arts  course  now  in  use.  It  is  appar- 
ent that  if  home  repair  and  construction  be  made  the  basis  for  a 
course  in  manual  arts,  it  is  not  necessary  to  use  the  project  method. 
For  once  the  processes  have  been  derived,  it  is  a  matter  of  choice 
as  to  whether  they  be  taught  systematically  and  in  isolation  from 
practical  jobs  as  projects  at  home  or  as  problems  in  the  shop.  The 
important  point  to  bear  in  mind  is  that  it  is  entirely  practicable 
to  draw  off  the  processes  from  home  projects  and  determine 
which  of  them  to  teach  and  emphasize. 


THE  DEVELOPMENT  OF  A  CHART  FOR  ATTAINMENTS 

IN  READING 

Joseph  P.  O'Hern 

Assistant  Superintendent  of  Schools,  Rochester,  New  York 

In  an  address  before  the  teachers  of  the  Rochester  public 
schools,  Dr.  William  S.  Gray  of  the  University  of  Chicago  declared 
that  there  was  a  lack  of  uniformity  in  our  aims  in  reading.  Re- 
flecting on  this  statement,  we  concluded  that  this  lack  of  uniform- 
ity in  aims  in  reading,  if  it  really  existed,  would  be  likely  to  have  a 
bearing  on  attainments  in  reading.  Accordingly,  we  decided  to 
ask  each  teacher  in  the  elementary  schools  to  state  the  three  chief 
aims  in  reading. 

When  these  replies  had  been  tabulated  it  was  perfectly  evident 
that  Dr.  Gray  was  right.  The  replies  brought  forth,  grade  by 
grade,  a  great  many  vague  and  indefinite  statements.  One 
teacher,  for  example,  gave  the  following  as  a  legitimate  first-grade 
aim  in  reading:  "To  lay  the  cornerstone  of  all  education."  On 
the  whole,  however,  we  received  a  body  of  material  worth  putting 
into  definite  shape  for  a  report  back  to  the  teachers.  This  led  us 
to  ask  the  teachers  for  a  restatement  of  their  aims  after  they  had 
made  a  careful  study  of  the  first  tabulation.  The  second  set  of 
replies  was  a  decided  improvement  over  the  first.  After  again 
sending  back  a  tabulation,  a  third  request  brought  a  body  of  ma- 
terial which  was  organized  by  a  committee  of  teachers  into  grades 
and  divisions.  The  result  was  a  reading  chart  to  which  we  have 
given  the  title  "Attainments  in  Reading."  The  material  con- 
tained in  the  chart  is  reproduced  in  connection  with  this  article. 

The  process  by  which  this  chart  was  built  up  covered  practi- 
cally two  years.  During  this  time  the  Gray  tests  in  reading  were 
given  in  different  schools ;  and  the  results  were  reported  to  teachers 
through  institutes  and  conferences,  and  through  printed  articles 
in  the  State  Teachers'  Journal.  The  measurement  work  showed 
beyond  doubt  that  the  teaching  of  silent  reading  was  deficient. 
This  led  to  a  more  serious  study  of  the  problem  of  reading  on  the 
part  of  the  whole  teaching  force. 

Hitherto  stress  had  been  laid  on  oral  reading  attainment.  The 
tests  revealed  that  practically  no  special  attention  was  being 
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given  to  the  matter  of  correct  "interpretation"  of  the  material 
read.  Children  could  read  orally  satisfactorily,  but  they  were  not 
being  encouraged  to  look  for  the  ''central  thought."  They  were 
not  required  to  "reproduce"  the  subject  matter  of  the  text  nor  to 
show  whether  or  not  the  "author's  aim"  had  been  sensed.  Al- 
though the  proper  mastery  of  arithmetic,  geography,  and  history 
is  based  directly  on  this  ability  to  grasp  the  central  thought,  to 
understand  the  author's  aim,  and  to  reproduce,  no  general  effect 
was  being  made  to  show  the  pupils  the  relationship  existing  be- 
tween good  reading  and  good  marks  in  arithmetic,  geography,  and 
history.  In  other  words,  no  definite  attempt  was  being  made  in 
our  schools  to  train  the  children  in  "effective  study  habits." 

When  it  was  brought  home  to  us  that  reading  was  not  just  an 
solated  subject  in  our  curriculum  but  was  closely  related  to  every 
other  subject,  we  realized  that  an  improvement  in  reading  would 
bring  about  a  corresponding  improvement  in  the  related  subjects. 
This  being  true,  the  next  step  was  to  determine  just  how  this  im- 
provement in  reading  ability  could  best  be  attained.  In  his  talk 
to  the  Rochester  teachers  in  1919  Dr.  Gray  said: 

The  results  of  studies  of  the  acquisition  of  reading  ability  enable  super- 
visors and  teachers  to  reach  certain  conclusions  in  regard  to  the  aims  of  cer- 
tain grades.  First,  emphasis  should  be  placed  on  the  content  of  what  is 
read  in  each  grade.  Second,  the  first  three  grades  should  be  devoted  largely 
to  the  attainment  of  a  high  degree  of  fluency  in  oral  reading.  Third,  some 
attention  should  be  given  to  problems  of  silent  reading  during  the  primary 
grades.  Habits  of  effective  silent  study  should  receive  large  attention  dur- 
ing the  fourth,  fifth,  and  sixth  grades.  Fourth,  ability  to  make  keen,  critical 
interpretation  of  what  is  read  should  be  emphasized  in  the  sixth,  seventh,  and 
eighth  grades. 

This,  briefly,  is  what  we  are  now  trying  to  do  in  Rochester. 
The  final  threshing  out  of  the  aims  suggested  by  the  teachers  re- 
sulted in  four  clear-cut  statements  essentially  the  same  as  those 
given  above  by  Dr.  Gray.  In  the  form  of  the  chart  as  actually 
placed  in  the  hands  of  the  teachers  these  were  entered  in  the  left- 
hand  column  under  the  general  caption  "Reading  Results."  To 
the  right  of  each  statement  of  aim  and  under  the  proper  grade  des- 
ignation were  given  specific  directions  for  accomplishing  the  aim. 
Thus  the  chart  is  not  a  group  of  suggestions,  but  an  actual  course 
of  study;  and  it  has  been  officially  adopted  as  such  by  the  board 
of  education.     In  order  that  the  reader  may  obtain  a  correct  idea 
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of  the  organization  of  the  chart,  an  outline  of  it  is  presented  in 
Figure  1. 
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In  the  form  of  the  chart  here  presented  each  of  the  statements 
of  aims  is  given  above  the  items  bearing  on  the  attainment  of 
these  results  in  each  grade.  The  four  statements  are:  (I)  perma- 
nent interest  in  reading,  (II)  economical  and  effective  study  habits, 
(III)  economical  and  effective  use  of  books,  (IV)  thorough  mastery 
of  the  mechanics  of  reading.  With  respect  to  "economical  and 
effective  study  habits"  the  attention  of  teachers  is  called  in  the 
chart  to  Dr.  Gray's  statement: 

I  consider  that  teaching  pupils  to  study  is  a  fundamental  part  of  the 
problem  of  teaching  pupils  to  read.  The  various  habits  of  study  which 
should  be  emphasized  correspond  to  the  study  problems  in  all  the  content 
subjects  as  well  as  in  the  study  of  literary  selections.  The  suggestions  con- 
cerning study  habits  in  the  fourth,  fifth,  and  sixth  grades  are  gathered  largely 
from  a  study  of  the  uses  which  pupils  are  required  to  make  of  reading  ability 
in  the  preparation  of  reading  assignments. 

ATTAINMENTS  IN  READING 

I.  PERMANENT  INTERESTS  IN  READING 

A.  Current  Events — (1)  Newspapers;  (2)  Magazines. 

B.  Books  of  Real  Worth— (1)  Fiction;  (2)  Poetry;  (3)  History;  (4) 

Science;  (5)  Biography;  (6)  Travel. 

Elindergarten 

1.  TeU  and  occasionally  read  interesting  stories  and  poems. 

2.  Read  simple  poems  and  ask  children  to  give  content. 

3.  In  dramatizing  simple  rhymes  and  stories  use  printed  cards  to  designate 

objects  and  characters. 
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4.  Encourage  children  to  observe  street  signs,  billboard  advertisements,  etc. 

5.  Read  from  story  books  brought  from  home  by  children. 

6.  Encourage  children  to  make  simple  booklets  containing  pictures  under 

which  teacher  may  print  title  suggested  by  child. 

First  Grade 

1.  Make  simple  printed  sheets  about  a  common  experience,  etc.    Call  this  a 

newspaper  to  bring  use  of  newspaper  before  children. 

2.  Reserve  portion  of  blackboard  to  be  designated  as  Bulletin  Board.  Print 

here  simple  directions  for  the  day  or  simple  notices  of  special  occasions. 

3.  Have  children  memorize  good  short  poems. 

4.  Use  primer  the  content  of  which  is  interesting  and  worth  while  from  a 

literary  standpoint. 

Second  and  Third  Grades 

1.  Short  talks  on  current  events  with  reference  made  to  newspapers  and 

magazines. 

2.  Select  books  with  interesting  content  and  good  literature.     Call  attention 

to  authors,  illustrators,  etc. 

3.  Direct  attention  to  interesting  books  to  read  independently. 

4.  Have  children  interpret  and  memorize  poems. 

5.  Arouse  a  desire  to  read  by  telling  part  of  a  story.     Let  children  tell  how  it 

might  end  and  then  read  remainder  of  story. 

6.  Have  many  sets  of  interesting  books  for  children  to  read. 

7.  Have  supplementary  books  that  may  be  taken  home. 

8.  Encourage  children  to  bring  their  own  books  to  be  u^ed  as  a  library. 

9.  Encourage  supplementary  reading  when  work  is  finished. 

Fourth  Grade 

1.  See  suggestions  for  second  and  third  grades. 

2.  Discuss,  in  a  very  simple  way,  current  events.    Have  pupils  bring  to  class 

clippings  from  newspapers  and  magazines  on  various  topics. 

3.  Encourage  drawing  books  from  public  library  for  project  reading. 

4.  Encourage  reading  aloud  to  parents  or  friends. 

5.  Encourage  much  silent  reading  at  home  for  pleasure.     Keep  in  touch  with 

what  pupils  are  reading  by  class  discussions  of  interesting  books  pupils 
have  read. 

6.  Arouse  interest  in  the  reading  of  poetry  by  reading  aloud  best  literary 

selections  to  class.     Follow  this  by  discussion. 

7.  Interest  pupils  in  good  literature  by  reading  to  class  a  chapter  or  two  of 

some  good  book  and  then  give  them  an  opportunity  to  finish  the  book 
independently. 

Fifth  Grade 

1.  See  suggestions  for  previous  grades. 

2.  Discuss  current  events.    Have  pupils  bring  to  class  clippings  from  news- 

papers and  magazines  on  projects  being  studied. 
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3.  Encourage  drawing  books  from  the  public  library  for  project  reading. 

4.  Keep  a  record  for  the  grade,  showing  title  and  author  of  all  books  read 

during  the  semester. 

5.  Encourage  oral  reading  at  home  to  give  others  pleasure. 

6.  Assign  to  individual  pupils  interesting  short  stories  to  be  read  at  home  for 

the  purpose  of  telling  to  the  class. 

7.  Assign  poem  to  entire  class  for  sUent  reading.     Then  select  several  chil- 

dren to  read  stanza  which  they  have  enjoyed. 

8.  Arouse  desire  to  read  good  literature  by  interesting  the  class  in  one  of  the 

great  writers.  Encourage  a  search  on  the  part  of  the  individual  pupils 
to  see  who  can  read  the  greatest  number  of  selections  by  this  author. 
Pupils  keep  individual  list  of  selections  or  books  read. 

Sixth  Grade 

1.  See  suggestions  for  previous  grades. 

2.  Discuss  current  events.     Elaborate  upon  fourth  and  fifth  grade  work  by 

having  pupils  make  individual  collection  of  newspaper  clippings  and 
magazine  articles  which  pertain  to  projects  being  studied  in  geography, 
history,  etc. 

3.  Stimulate  interest  in  reading  library  books  by  each  month  writing  on  the 

board  a  list  of  several  worth  while  books  for  the  children  to  read  inde- 
pendently. 

4.  Keep  several  interesting  books  upon  a  reading  table  and  permit  individual 

pupils  to  read  these  whenever  other  work  is  finished.  Frequently  add 
new  books  and  call  attention  of  class  to  them. 

5 .  Develop  the  habit  of  pupil's  keeping  an  individual  record  of  all  books,  short 

stories,  poems,  magazine  articles,  etc.,  read.  Insist  upon  exact  title, 
author  and  source  being  noted.     Contests  will  stimulate  this  work. 

6.  Begin  a  more  intensive  study  of  poems,  by  helping  the  pupils  to  recognize 

and  appreciate  the  various  pictures  or  ideas  which  the  poem  aims  to 
convey. 

II.  ECONOMICAL  AND  EFFECTIVE  STUDY  HABITS 

A.  Analysis — (1)  Central    thought;    (2)  Author's    aim;  (3)  Characters; 

(4)  Problems. 

B.  Correlation — (1)  With  previous  experience  and  reading;  (2)  With 

similar  material. 

C.  Judgment — (1)   Value;  (2)   Validity. 

D.  Interpretation. 

E.  Reproduction. 

Kindergarten 

1.  Interest  pupil  in  reading  as  a  thought  process,  through  incidental  reading 

such  as  looking  over  shoulder  while  teacher  reads. 

2.  Have  children  reproduce  poem  or  story  in  their  own  words. 

3.  Teacher  or  child  repeat  rhyme  which  has  been  memorized  and  a  child  or 

entire  group  supply  rhyming  words. 
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4.  Teacher  read  story  already  familiar  to  the  children.     Stop  at  frequent 
intervals  and  have  children  tell  the  next  thing  that  happened. 

First  Grade 

1.  Give  special  attention  to  content  of  what  is  read. 

2.  Have  children  pick  out  words,  phrases  or  groups  of  words  from  the  sen- 

tences. 

3.  Have  children  read  nursery  rhymes  and  familiar  short  stories  to  gain  power 

in  reproducing  the  thought. 

4.  For  thought  getting,  have  children  reproduce  what  has  been  read  the  pre- 

vious day. 

5.  Have  children  read  silently  with  the  idea  of  telling  the  story  to  the  class. 

6.  Have  children  relate  materials  read  to  previous  experience. 

7.  Have  children  follow  accurately  either  printed  or  written  directions. 

8.  Lead  children  to  find  important  idea  or  ideas  of  a  selection. 

9.  Have  children  read  questions  silently  and  give  answers  orally. 

10.  Write  brief  descriptive  sentences  about  a  pupil  and  have  children  guess 

who  is  described. 

11.  Ask  questions  about  thought  unit  or  page  that  has  been  read  silently. 

12.  Give  dramatization  and  picture  study  a  prominent  place  in  thought 

getting. 

13.  Lead  children  to  observe  sequence  of  important  ideas. 

Second  and  Third  Grades 

1.  Lead  children  to  find  answers  to  simple  problems,  later  to  more  difficult 

ones. 

2.  Have  children  relate  materials  read  to  previous  experience. 

3.  Have  children  follow  accurately  either  printed  or  written  directions. 

4.  Lead  children  to  find  important  idea  or  ideas  of  a  selection. 

5.  Lead  children  to  find  a  series  of  closely  related  points. 

6.  Develop  attitude  and  habit  of  looking  for  meanings  in  all  reading  exer- 

cises : 

Note: — Put  questions  on  the  board  and  have  children  read  to  find 
answers  to  questions.  Let  children  question  each  other  on  a  selection 
which  has  been  read.  Let  children  tell  meaning  of  words  by  giving  other 
words  that  could  be  used  instead.  Children  should  be  able  to  answer 
accurately  any  questions  after  one  reading  of  a  simple  selection. 

7.  Train  children  to  remember  and  reproduce. 

8.  Have  children  suggest  appropriate  titles  for  a  story  or  for  various  parts 

of  a  story. 

9.  Develop  the  habit  of  finding  simple  quotations. 

10.  Lead  children  to  find  the  central  thought. 

11.  Lead  children  to  find  descriptions. 

12.  Have  the  children  find  the  part  of  selection  which  gives  most  knowledge 

of  a  certain  character. 

13.  Have  children  find  elements  of  time  and  place. 

14.  Have  children  compare  characters  in  stories  to  those  in  life.     Have  them 

select  chief  characters  and  minor  characters. 
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15.  Give  dramatization  of  stories  a  prominent  place  in  thought  getting. 

16.  Allow  children  to  illustrate  stories  with  water  colors,  crayons,  plasticine, 

free  hand  cuttings,  etc. 

17.  Encourage  children  to  form  mental  pictures  of  what  is  read.    Teacher 

may  check  up  on  accuracy  of  pictures  thus  formed  by  having  children 
describe  them  orally. 

18.  Train  children  to  give  definite  questions, 

19.  Have  children  give  their  own  interpretation  of  an  illustration  and  com- 

pare with  the  story  of  the  author. 

20.  Have  children  tell  what  they  like  and  what  they  do  not  like  in  a  selection 

and  why. 

Fourth  Grade 

1.  Find  the  central  idea  in  paragraphs  and  short  selections  in  which  points 

are  fairly  evident. 

2.  Find  the  author's  aim  or  purpose  in  short  selections  in  which  the  author's 

purpose  is  fairly  evident.    Discussions  initiated  by  teacher. 

3.  Discover  problems  for  study  and  investigation  in  connection  with  mate- 

rial which  is  closely  related  to  interesting  problems  for  study.  Teacher 
asks  questions. 

4.  Find  a  series  of  closely  related  points  in  short  selections  in  which  the 

points  are  fairly  evident.  Teacher  writes  points  on  board  as  they  are 
selected. 

5.  Determine  the  relative  importance  of  statements  in  regular  reading 

material.  Teacher  directs  discussions  to  proper  conclusions,  laying 
foundation  for  independent  judgments. 

6.  Associate  material  read  with  previous  experience  in  selections  con- 

taining much  material  related  to  pupils'  immediate  experiences. 
Pupils  encouraged  to  report  their  experiences, 

7.  Find  answers  to  thought-provoking  questions  which  are  asked  by  pupils 

or  teacher  in  relatively  easy  assigned  passages.  Answers  derived 
directly  from  content, 

8.  Select  facts  which  relate  to  a  problem  under  discussion  in  relatively 

easy  assigned  passages.  Problem  suggested  by  pupils  or  assigned  by 
teacher.  Pupils  search  for  facts  which  bear  directly  on  problem. 
Each  pupil  recognizes  why  decisions  are  good  or  poor. 

9.  Draw  valid  conclusions  from  material  read  in  relatively  simple  selec- 

tions. Problem  assigned  by  teacher.  Reasons  for  conclusions  carefully 
explained. 

10.  Judge  the  validity  of  statements  in  material  which  presents  statements 

the  validity  of  which  might  be  questioned.  Teacher  challenges  state- 
ments and  recalls  statements  or  experiences  which  are  at  variance 
with  those  read.    Lays  foundation  for  a  critical  attitude. 

11.  Remember  and  reproduce  short  selections  containing  narrative  and 

descriptive  material. 

12.  Train  in  keen  critical  interpretations  of  simple  material  in  which  in- 

terpretations are  based  on  pupils'  experiences,  previous  reading,  on 
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meanings  derived  from  a  study  of  the  context,  the  dictionary,  or  notes 
and  explanations  in  the  books  used  by  pupils.    Teacher  directs  and 
supervises  closely. 
13.  Dramatize  informally  short  stories. 

Fifth  Grade 

1.  Find  the  central  idea  in  more  difficult  paragraphs  and  selections,  careful 

weighing  of  values  necessary  to  select  the  most  important  idea. 

2.  Find  the  author's  aim  or  purpose  in  longer  and  more  difficult  selections. 

Responsibility  imposed  on  pupils  for  decisions. 

3.  Discover  problems  for  study   and   investigation  in   connection   with 

assigned  material  in  various  subjects.  Pupils  required  to  discover 
correlated  topics  or  problems. 

4.  Find  a  series  of  closely  related  points  in  longer  and  more  difficult  selec- 

tions in  which  the  points  are  not  so  evident.  Pupils  select  inde- 
pendently.   Form  of  organization  considered. 

5.  Determine  the  relative  importance  of  statements  in  regular  reading 

miaterial.  Pupils  required  to  distinguish  independently  between  the 
important  and  unimportant  in  well  organized  selections. 

6.  Associate  material  read  with  previous  experience  in  selections  normally 

read  by  the  class.  Pupils  required  to  search  independently  for  related 
experiences  and  to  explain  author's  meanings  in  terms  of  their  own 
experience. 

7.  Find  answers  to  thought-provoking  questions  which  are  asked  by  pupils 

or  teacher  in  more  difficult  assigned  material.  Answers,  derived 
through  thoughtful  consideration  of  content;  in  assigned  material 
from  several  sources. 

8.  Select  facts  which  relate  to  a  problem  under  discussion  in  relatively 

difficult  assigned  passages  and  in  material  from  various  sources. 
Pupils  trained  to  diflferentiate  carefully  between  that  which  does  and 
that  which  does  not  relate  to  the  problem  in  hand. 

9.  Draw  valid  conclusions  from  material  read  in  selected  material  nor- 

mally read  by  the  class.  Responsibility  placed  on  class  to  weigh  values 
and  to  support  conclusions. 

10.  Judge  the  validity  of  statements  in  material  which  presents  conflicting 

statements.  Responsibility  placed  on  pupils  to  discover  such  dis- 
crepancies. Evidence  supporting  each  point  of  view  carefully  con- 
sidered.   Teacher  refers  class  to  an  authoritative  statement. 

11.  Remember  and  reproduce  longer  selections  in  which  some  selection 

and  reorganization  are  necessary  to  meet  the  requirements  of  the 
assignment. 

12.  Train  in  keen,   critical  interpretations  of  more  difficult  material  in 

which  considerable  thinking  is  necessary  to  reach  valid  conclusions. 
Problems  assigned  by  teacher.  Responsibility  imposed  on  pupils  to 
look  up  necessary  facts  and  to  draw  conclusions. 

13.  Dramatize  informally  longer  stories. 
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Sixth  Grade 

1.  Find  the  central  idea  in  still  more  difficult  paragraphs  and  long  stories. 

Careful  analysis  and  clear  thinking  required. 

2.  Find  the  author's  aim  or  purpose  in  all  types  of  selections  ordinarily 

assigned.  Judgment  of  pupils  refined  by  estimating  extent  to  which 
author  realized  his  purpose. 

3.  Discover   problems   for   study   and    investigation   in   connection   with 

content  subjects.  Pupils  given  opportunity  to  read  for  a  day  or  two  to 
discover  problems  which  should  be  studied  in  connection  with  a  given 
topic. 

4.  Find  a  series  of  closely  related  points  in  difficult  selections  and  mate- 

rial drawn  from  several  sources.  Statements  carefully  worded.  Rela- 
tionships clearly  indicated  by  form  of  organization. 

5.  Determine  the  relative  importance  of  statements  in  more  or  less  diffi- 

cult material.  Pupils  required  to  discuss  relative  values  freely  and 
to  criticize  the  organization  and  relative  value  of  various  parts  of 
assigned  material. 

6.  Associate   material  read  with  previous  experience  in  selections  con- 

taining references  to  various  fields  such  as  history,  geography,  nature 
study,  etc.  Relationship  to  these  general  fields  recognized  and  brought 
out  by  pupils. 

7.  Find  answers  to  thought-provoking  questions  which  are  asked  by  pupils 

or  teacher  in  relatively  difficult  selections;  in  material  from  various 
sources  selected  in  part  by  pupils. 

8.  Select  facts  which  relate  to  a  problem  under  discussion  in  difficult  pas- 

sages and  in  material  selected  independently  by  the  pupils.  This 
requires  training  in  looking  up  topics  in  textbooks  and  books  of 
reference. 

9.  Draw  valid  conclusions  from  material  read  in  difficult  selections  and  ma- 

terial drawn  from  various  sources.  Pupils  required  to  state  con- 
clusions and  to  give  evidence  which  supports  them. 

10.  Judge  the  validity  of  statements  in  all  material  read.     Critical  attitude 

encouraged.  Pupils  trained  in  the  various  types  of  source  material  in 
determining  the  validity  of  statements. 

11.  Remember  and  produce  material  from  several  sources,  organized  and 

put  in  form  for  a  coherent,  clear-cut  presentation. 

12.  Train   in   keen,   critical   interpretations   of   difficult   material.     Pupils 

trained  to  distinguish  between  passages  which  need  careful  study  and 
those  which  do  not.  Special  training  provided  in  the  use  of  appropriate 
helps  and  in  keen  interpretations  of  materials. 

13.  Dramatize  selections  or  single  chapters  from  any  long  selection.      Make 

definite  assignments  for  home  reading  to  groups  of  pupils  in  order 
that  they  may  work  out  the  necessary  details  for  simple  dramatization. 

14.  Discuss  title.      Why  has  author  chosen  title?     After  reading  part  of 

story  let  children  suggest  suitable  titles.  Show  relationship  between 
title  and  story. 


Mar.  1921      A  CHART  FOR  ATTAINMENTS  IN  READING  189 

15.  Find  important  units  of  thought.  Choose  a  name  for  important  divisions 
of  the  story.  Write  name  chosen,  introductory  and  closing  words. 
Emphasize  the  limits  of  complete  thought  units  by  requiring  pupils 
to  read  to  class  introductory  and  closing  words. 

III.  ECONOMICAL  AND  EFFECTIVE  USE  OF  BOOKS 

A.  Library — (1)  Card  index;  (2)  Reference  books  and  indices;  (3)  En- 

cyclopedias. 

B.  Helps — (1)  Notes;  (2)  Index;  (3)  Glossary;  (4:)  Chapter  headings. 

Kindergarten 

1 .  Encourage  children  to  bring  their  own  attractively  illustrated  story  books 

to  be  enjoyed  by  the  whole  group. 

2.  Encourage  children  to  bring  stories  and  pictures.     These  may  be  assem- 

bled into  a  booklet  which  might  be  made  for  first  grade  or  for  an  ab- 
sent member  of  the  class. 

3.  Train  pupils  to  turn  pages  without  tearing  them. 

First  Grade 

1.  Encourage  children  to  bring  alphabet  books  with  pictures  and  names. 

2.  Develop  on  the  board  stories  of  a  few  short  sentences  about  a  common 

experience  or  descriptive  stories.     Afterward  print  these  stories  on 
sheets  and  have  children  combine  into  booklets. 

3.  Select  primer  with  attention  to  content. 

4.  Have  lessons  on  use,  handling  and  care  of  books;  proper  position,  how  to 

turn  pages,  order  of  paging  and  exercises  in  finding  given  pages  rapidly. 

5.  Emphasize  the  importance  of  clean  hands  and  care  in  handling  books. 

Second  and  Third  Grades 

1.  Direct  attention  to  book,  title,  author,  illustrator,  publisher,  date  pub- 

lished, table  of  contents.     Develop  skill  in  finding  titles  in  table  of 
contents. 

2.  Direct  attention  to  differences  in  same  story  as  told  in  different  books: 

Note  : — Have  silent  reading  of  different  version  of  a  story  which  has 
been  previously  developed. 

3.  Direct  attention  to  interesting  books  to  be  read  independently,  on  some 

project  or  problem. 

4.  Complete  training  in  finding  pages  quickly. 

Fourth  Grade 

1.  See  suggestions  for  second  and  third  grades. 

2.  Give  instruction  in  use  of  table  of  contents,  chapter  headings,  glossary, 

etc.     Teach  these  points  only  in  the  most  simple  form. 

3.  Give  instruction  in  use  of  several  books  to  secure  information  on  a  given 

problem. 

4.  Give  training  in  the  economical  and  effective  use  of  dictionary. 
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Fifth  Grade 

1.  See  suggestions  for  previous  grades. 

2.  Emphasize  use  of  several  reference  books  and  various  source  material. 

3.  Insist  upon  pupils  locating  all  topics  by  aid  of  table  of  contents  or  index. 

4.  Call  frequent  attention  to  the  help  to  be  gained  by  careful  study  of  para- 

graph headings. 

5.  Train  pupils  to  use  supplementary  list  of  words  in  back  part  of  diction- 

ary. 

Sixth  Grade 

1.  See  suggestions  for  previous  grades. 

2.  Give  instruction  in  use  of  encyclopedia.    This  shovild  be  of  simple  char- 

acter. 

3.  Arrange  with  librarian  for  class  to  visit  school  or  public  library  for  the 

purpose  of  studying  the  use  of  card  index. 

4.  Develop  habit  of  evaluating  material  to  be  used  in  preparing  assignments 

by  aid  of  table  of  contents,  index,  chapter  and  paragraph  headings. 

5.  Teach  meaning  and  use  of  foot  note,  marginal  note  and  cross  reference  if 

discovered  in  any  material  studied. 

IV.  THOROUGH  MASTERY  OF  THE  MECHANICS  OF  READING 

A.  Silent  Reading — (1)  Comprehension;  (2)  Rate. 

B.  Oral    Reading — (1)  Word   Mastery;    (2)  Phonetic  analysis;    (3) 

Fluency. 

Kindergarten 
A.     Silent  Reading 

1.  Teach  children  to  recognize  their  own  names. 

2.  Place  the  children's  dictated  ideas  on  the  board. 

3.  Lead  children  to  see  that  different  symbols  have  different  meanings. 
(A)  By  noticing  street  and  car  signs,  etc.,  when  out  for  a  walk.      (B)  By 

looking  at  picture  books,  etc.,  in  the  room. 

4.  Label  articles  of  furniture,  pictures,  etc.,  with  their  names. 

B.    Oral  Reading 

1.  Using  "A,  B,  C"  books  with  large  type,  have  children  find  words  and 

letters  that  are  alike. 

2.  Have  children  tell  words  that  begin  with  the  same  sound  or  have  the 

same  ending. 

3.  Get  vocabulary  from  the  first  grade  teacher  and  use  in  conversation. 

4.  Use  games  with  cards  on  which  are  written  the  names  of  the  days,  months, 

members  of  the  family,  etc. 

5.  Organize  vocabulary  common  to  group  at  beginning  of  semester.    To 

this  add  from  time  to  time  new  words. 

6.  To  increase  vocabulary  the  teacher  may  bring  new  words  to  the  attention 

of  the  child  by  constant  repetition  in  conversation.    The  child  ab- 
sorbs them  unconsciously. 
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First  Grade 
A.     Silent  Reading 

1.  Have  some  silent  reading.    This  may  be  rereading  of  a  story  previously 

read  to  find  answers  to  questions,  or  it  may  be  another  version  of  the 
same  story  in  order  to  find  differences. 

2.  Have  pupils  reread  silently  story  previously  read  or  some  story  in  a  new 

version  to  gain  fluency  and  better  rate. 

3.  Give  children  questions  printed  on  slips  to  be  read  silently  and  answered 

orally. 

4.  Have  short  stories  (with  pictures)  pasted  on  cards  to  be  read  silently  and 

told  in  child's  own  words. 

B.    Oral  Reading 

1.  Give  children  newspaper  clippings  and  have  children  underscore  familiar 

words. 

2.  Use  flash  card  exercises,  short  phrases  and  action  sentences. 

3.  Write  sentences  on  the  board,  one  shown  at  a  time,  short  exposure. 

4.  Have  oral  reading  that  children  may  connect  known  word  with  printed 

symbol.     Reading  for  thought  not  pronunciation  of  words  and  enun- 
ciation. 

5.  Have  exercises  to  overcome  the  tendency  to  detach  the  articles   "a," 

"an,"  "the"  from  the  noun. 

6.  Secure  Word  Mastery  through: — 

(a)  Aid  of  comparison — i.  e.    Matched  with  word  under  known 

picture  or  word  known  in  committed  sentence. 

(b)  Knowledge  of  meaning  of  sentence — words  recognized  through 

resemblance  to  known  words. 

(c)  Words  recognized  at  sight. 

(d)  Unfamiliar  words  recognized  through  phonetic  analysis. 

Second  and  Third  Grades 
A.     Silent  Reading 

1.  Provide  for  extensive  reading  of  simple  selections  to  gain  rate  and  span 

of  recognition. 

2.  Rapid  reading  of  simple,  easy  material  should  very  often  be  done  under 

timed  conditions. 

3.  Give  small  amount  of  silent  reading  on  projects  or  to  gather  material  for 

dramatization. 

4.  Encourage  either  oral  or  silent  reading  just  for  pleasure. 

B.    Oral  Reading 

1.  Make  word  books  in  preparation  for  dictionary  work. 

2.  Encourage  children  to  report  new  words  found  in  outside  reading. 

3.  Have  children  make  lists  of  certain  kinds  of  words  as:    "time  words," 

"place  words,"  "descriptive  words,"  etc. 

4.  DriU  to  emphasize  importance  of  words  commonly  confused,  such  as 

"when  and  then,"  "saw  and  was."     Show  how  carelessness  in  looking 
at  these  may  change  the  meaning  of  a  sentence  or  paragraph. 
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5.  Continue  word  drill  and  phonetic  analysis  of  monosyllabic  words  with 

opportunity  provided  for  application. 

6.  Develop  accuracy  and  independence  in  word  recognition. 

7.  Finish  phonetic  analysis  of  monosyllabic  words  and  lay  foundation  for 

polysyllabic  words. 

8.  Complete  flash  card  exercises  of  longer  phrases  and  sentences. 

9.  Complete  essential  training  in  fundamentals  of  oral  reading  with  natural- 

ness of  expression. 

10.  Have  oral  reading  in  real  audience  situation  to  gain  ability  to  read  clearly 

and   effectively. 

Fourth  Grade 
A.     Silent  Reading 

1.  Have  at  least  half  of  the  reading  silent  reading. 

2.  Have  silent  reading  on  projects  in  connection  with  history,  geography,  etc. 
2>.     Give  opportunity  for  quantitative  silent  reading  with  special  instruction  in 

the  art  of  effective  silent  reading. 

4.  Allow  children  to  read  easy,  interesting  stories  for  short  period,  securing 

rhythmical  sweeps  with  few  fixations  as  child  is  absorbed  in  story. 

5.  Give  speed  drills  in  reading  for  thought.     Borrow  supplementary  readers 

from  lower  grade. 

6.  Encourage  pupils  to  reread  simple,  familiar  material.      Place  a  time  limit 

and  see  how  many  pupils  approach  the  standard  rate. 

7.  Give  informal  or  standardized  tests  both  for  comprehension  and  rate. 

Give  the  class  standards  to  be  obtained  and  allow  pupils  to  keep  their 
own  scores  so  that  they  may  know  their  progress. 

B.     Oral  Reading 

1.  Review  phonetic  rules  and  principles. 

2.  See  suggestions  for  previous  grades. 

3.  Drill  on  word  analysis  for  content  and  pronunciation. 

4.  Give  attention  to  syllabication  and  accent. 

5.  Begin  in  this  grade  a  systematic  study  of  the  dictionary.     Drill  on  alpha- 

betic arrangement  of  words  to  the  third  letter  (see  Course  of  Study  in 
English).     Emphasize  purpose  of  words  in  heavy  type  at  top  of  page. 

6.  Develop  habit  of  consulting  dictionary  for  pronunciation  and  meaning 

of  unfamiliar  words.     Show  value  of  diacritical  marks  in  this  connec- 
tion. 

7.  Lead  children  to  determine  meaning  of  unfamiliar  words  by  context. 

8.  Provide  audience  situations  for  oral  reading.     Occasionally  require  a 

summary  by  individual  pupils  of  what  has  been  read  to  class. 

Fifth  Grade 
A.     Silent  Reading 

1.  See  suggestions  for  previous  grades. 

2.  Increase  amount  of  silent  reading  to  about  ratio  of  60  to  40. 

3.  Extend  time  for  reading  interesting  stories  to  secure  better  rate. 
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4.  Provide  opportunity  for  silent  reading  from  several  books  for  the  purpose 

of  collecting  information  in  connection  with  some  project  being 
studied. 

5.  Try  to  determine  by  means  of  informal  or  standardized  tests  the  indi- 

vidual difficvilties  children  encounter  in  silent  reading. 

B.    Oral  Reading 

1.  Emphasize  all  points  noted  for  third  and  fourth  grades. 

2.  Extend  the  study  of  the  dictionary.    Make  daily  assignments  in  spelling, 

etc.,  of  definite  words  for  which  the  dictionary  should  be  consulted. 

3.  Place  a  greater  emphasis  on  word  analysis  in  derivation  of  meanings. 

4.  Encourage  each  pupil  to  keep  individual  lists  of  the  meaning  of  all  new 

words  for  which  the  dictionary  has  been  consulted. 

5.  Continue  the  study  of  the  rules  of  accent  and  syllabication.    Apply  ndes 

to  new  polysyllabic  words  encountered  in  reading. 

Sixth  Grade 
A;^   Silent  Reading 

1.  Amplify  all  points  noted  for  third,  fourth  and  fifth  grades. 

2.  Give  special  drill  on  any  points  noted  for  previous  grades  in  which  your 

individual  grade  seems  to  have  difficulty. 

3.  Locate  individual  difficulties  through  the  use  of  informal  or  standardized 

tests. 

4.  Increase  amount  of  silent  reading  to  about  70  to  30. 

5.  Motivate  silent  reading  of  reference  material  by  definite  assignments  in 

connection  with  projects  or  problems  being  studied. 

6.  Help  pupils  to  recognize  the  difference  between  quick  reading  with  slight 

attention  to  details  and  careful,  intensive  reading  by  training  them  to 
quickly  scan  a  paragraph  or  page  for  the  purpose  of  deciding  whether 
its  content  is  worthy  of  careful  study. 

B.    Oral  Reading 

1.  Provide  for  special  drill  on  any  points  previously  noted  which  have  not 

become  habituated  by  the  class. 

2.  Insist  upon  the  independent  use  of  the  dictionary  when  needed. 

3.  Encourage  pupils  to  be  alert  in  detecting  errors  in  their  own  pronunciation 

and  generous  in  helping  other  pupils  to  overcome  their  errors. 

In  order  to  bring  the  matter  definitely  to  the  attention  of  all 
concerned  every  teacher  in  the  system  was  provided  with  a  copy 
of  the  chart  for  personal  use  and  for  display  in  the  classroom.  It 
was  discussed,  in  detail,  at  the  general  institute  held  just  previous 
to  the  opening  of  school  in  September,  1920;  and  it  has  subse- 
quently been  taken  up  at  various  principals'  meetings.  The  prin- 
cipals have  reported  the  results  of  these  meetings  back  to  their 
teachers.  As  a  consequence  of  all  this  the  teachers  are  fully  alive 
to  the  situation. 
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Already  suggestions  for  improvement  are  coming  to  the  central 
oJSice  from  principals  and  teachers.  The  chart  is  not  regarded  as 
a  perfect  piece  of  work  by  any  means.  It  is  to  be  revised  next  year 
in  the  light  of  this  year's  experience  and  many  of  the  suggestions, 
now  on  file,  will  be  incorporated  in  the  next  draft. 

It  is  also  planned  to  place  not  only  a  copy  of  the  large  chart  in 
the  hands  of  each  teacher  but  also  a  chart  of  more  convenient  size 
which  will  contain  only  the  general  aims  in  reading  and  the  spe- 
cific directions  for  the  grade  in  question. 

The  principals  and  teachers  of  Rochester  have  approached  the 
problem  of  reading  in  a  scientific  spirit  and  with  open  minds. 
Good  reading  ability  is  not  the  cure-all  for  every  ill,  but  we  believe 
that  if  the  children  in  our  schools  are  really  taught  economical  and 
effective  use  of  books,  and  are  helped  to  attain  permanent  reading 
interests,  we  have  given  them  the  tools  with  which  they  may  work 
out  with  greater  satisfaction  to  themselves  and  to  us  their  imme- 
diate problems  in  arithmetic,  history,  and  geography.  To  that 
end  have  we  organized  the  "Attainments  in  Reading"  chart. 


INEQUALITY  OF  EDUCATIONAL  OPPORTUNITY 

Gilbert  L.  Brown 
Northern  State  Normal  School,  Marquette,  Michigan 

A  Study  of  the  Schools  in  a  Michigan  Village 

We  hear  a  great  deal  today  about  equality  of  educational  op- 
portunity in  America.  It  is  difficult,  however,  for  one  who  de- 
votes much  time  to  visiting  rural,  village,  and  city  schools  to  hear 
this  doctrine  without  vigorous  protest.  At  any  rate,  one  is  led  to 
insist  upon  a  distinction  between  equality  and  identity  of  oppor- 
tunity. 

Identity  of  opportunity  means  that  the  same  opportunity  is 
open  to  all  pupils  regardless  of  their  abilities  and  interests.  Equal- 
ity of  opportunity  signifies  that  the  pupil  is  offered  opportunities 
in  accordance  with  his  abilities  and  interests.  Accepting  this  dis- 
tinction there  is,  in  a  very  general  way,  identity  of  opportunity. 
But,  when  we  consider  an  area  as  great  as  that  of  a  country,  even 
identity  is  apparent  and  not  real,  since  one  school  has  adequately 
trained  teachers,  another  has  teachers  of  little  training;  one  pos- 
sesses ample  equipment,  another  has  none;  and  one  is  provided 
with  a  modern,  comfortable  building,  while  another  has  a  building 
unfit  for  school  purposes.  On  the  other  hand,  we  have  scarcely 
begun  to  consider  equality  of  opportunity;  in  truth,  many  have 
not  yet  been  convinced  of  the  desirabiUty  of  equality  as  opposed  to 
identity.  The  general  practice  is  to  require  all  pupils  to  study  the 
same  subjects  in  the  same  way,  and  to  make  no  distinction  be- 
tween mentally  deficient  and  bright  pupils;  nor  between  those  me- 
chanically gifted  and  those  who  possess  special  abilities  in  other 
fields.  All  must  be  passed  through  the  same  "mill";  individual 
differences  must  be  disregarded. 

It  is  true  that  the  problem  of  equality  is  being  worked  out 
with  a  fair  degree  of  success  in  some  schools,  but  these  are  rela- 
tively few  in  number  and  are  confined  very  largely  to  cities.  The 
schools  in  which  least  progress  is  being  made  are  those  of  the  small 
village  and  rural  community.  In  this  paper  we  are  concerned, 
primarily  with  the  village  school.  The  following  analysis  in- 
volves an  examination  of  the  pupils,  teachers,  buildings,  equip- 
ment, and  the  course  of  study. 
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The  Pupils 
In  a  certain  village  employing  five  teachers,  the  Binet 
test  was  given  to  the  entire  school,  consisting  of  the  twelve 
grades.  Table  I  shows  the  distribution  of  the  pupils  according 
to  intelligence  (I.  Q.)  and  school  grades.  It  will  be  readily  ob- 
served that  somewhat  more  than  one-half  of  the  pupils  are  below 
normal  intelligence;  and  that  the  proportion  of  feebleminded, 
borderline,  and  dull  cases  is  abnormally  large. 

TABLE  I.      CLASSIFICATION  OF  PUPILS  ACCORDING  TO  INTELLIGENCE 
(l.  Q.)  AND  SCHOOL  GRADE 


Classification 

I.Q. 

GHM)Z 

Total 

I 

n 

in 

IV 

V 

VI 

vn 

vm 

DC 

X 

XI 

xn 

Genius  or  "near" 
genius 

above  140 

120-139 

110-119 

90-109 

80-89 

70-79 

50-69 
25-49 

Very  superior 

Superior 

3 
7 
4 
11 
1 

3 

1 

1 
4 
6 
2 

1 

1 
5 
5 
3 

2 

4 
2 

1 

1 

6 

4 
3 

1 

14 

Normal 

3 
3 
2 

3 
3 
2 

2 

1 
1 

34 

Dull 

2 

3 
2 

1 
2 

42 

Borderline 

Feebleminded 
moron 

18 
8 

Imbecile 

1 

Totals 

30 

13 

17 

6 

18 

8 

8 

11 

2 

5 

3 

2 

123 

This  last  fact  is  made  especially  evident  in  Table  II  which  ex- 
hibits at  each  intelligence  level  a  comparison  between  the  number 
of  children  in  this  school  and  the  number  which  we  should  find  in 
a  typical  school  of  the  same  size. 

It  will  be  observed  at  once  that  the  number  of  pupils  below 
normal  is  unusually  large.  This  condition  is  at  least  partially  ex- 
plained by  the  fact  that  in  the  village  there  has  been  a  selection 
of  families  based  upon  industrial  intelligence;  that  is,  many  of  the 
workmen  showing  considerable  ability  have  been  directed  to  larger 
centers,  places  in  which  greater  skill  or  foresight  is  required. 
Besides,  the  work  in  the  industry  supporting  this  village  involves 
more  drudgery  than  the  same  industry  in  neighboring  villages  and 
cities. 
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TABLE  II.      COMPARISON  WITH  TYPICAL  SCHOOL 


Intelligence 

Number  of  Pupils 

Number  to  be 

Deviation  from 

Quotient  of 

(entire  school) 

Expected  If  School 

Normal 

Pupils 

Is  Typical 

120-139 

6 

8 

2 

110-119 

14 

16 

2 

90-109 

34 

74 

40 

80-89 

42 

16 

26 

70-79 

18 

7 

11 

50-69 

8 

1 

7 

25-49 

1 

K?) 

In  Table  III,  the  language  spoken  in  the  home  of  the  pupil  is 
shown,  together  with  the  number  speaking  each  language  at  the 
different  mental  levels.  An  examination  of  the  table  brings  out 
the  fact  that,  of  the  English  speaking  pupils,  56.6  percent  are  below 
normal;  of  the  Finnish,  53.6  percent;  of  the  French,  61  percent. 

TABLE   III.      LANGUAGES   SPOKEN   IN  PUPILS'   HOMES 


Intelligence 
Quotient 
of  Pupils 

English 

Finnish 

French 

Italian 

Swedish 

Total 

120-139 

5 

6 

15 

21 

11 

2 

1 

6 

12 

13 

5 
3 
1 

6 

110-119 

2 
5 
6 
2 
3 

14 

90-109 

80-89 

70-79 

1 
1 

1 
1 

34 
42 
18 

50-69 

8 

25-49 

1  . 

Total 

60 

41 

18 

2 

2 

123 

A  comparison  of  the  pupils  speaking  English  only  with  those 
speaking  a  foreign  language  in  the  home  shows  that  a  somewhat 
higher  percent  of  the  former  are  below  normal  intelligence,  the 
ratio  being  56.6  to  55.5.  In  giving  the  tests  all  pupils  not  speak- 
ing or  understanding  Engligh  well  were  tested  in  their  native 
tongue.  I  have  found  in  testing  a  large  number  of  children  who 
speak  a  foreign  language  in  the  home  that  after  they  have  asso- 
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dated  with  English-speaking  children  for  a  year  and  a  half  or  two 
years  they  test  as  high  in  English  as  in  their  native  language. 

Teachers 

The  teachers  of  the  grammar-  and  high-school  grades  are  nor- 
mal-school graduates,  and  have  taught  five  years  or  more.  They 
are  fairly  well  prepared  for  most  of  their  work.  The  remaining 
three  teachers  are  high-school  graduates,  have  had  six  weeks  of 
normal-school  training,  and  have  taught  from  one  to  five  years. 
Of  course,  these  teachers  are  almost  wholly  unprepared  for  their 
work,  especially  for  teaching  those  pupils  who  speak  only  a  foreign 
language.  The  lack  of  preparation  is  illustrated  by  the  fact  that 
in  many  cases  these  pupils  receive  no  direct  instruction  in  the 
English  language,  but  are  required  to  remain  in  school  throughout 
the  day  in  order  that  they  may  "pick  up"  the  language  by  hearing 
others  speak  it. 

Teaching  Equipment 

The  equipment  is  meager.  Two  of  the  five  rooms  are  provided 
with  globes  and  maps  for  the  teaching  of  geography.  Each  of  the 
elementary  grades  has  two  sets  of  supplementary  readers,  which 
are  old  and  in  bad  condition.     The  school  has  no  library  facilities. 

Building 
The  building  was  originally  a  one-room  school,  but,  as  the  pop- 
ulation of  the  village  increased,  two  additional  rooms  were  built 
on  the  ground  and  two  above  the  three.  In  so  far  as  one  can  see 
there  was  no  design  or  plan  except  to  provide  a  place  to  keep  the 
pupils  during  school  hours.  The  heating,  lighting,  and  ventila- 
tion are  extremely  bad.  Two  rooms  are  separated  by  a  beaver- 
board  partition  only.  In  case  of  fire,  there  are  but  two  narrow 
exits.  The  building,  set  in  the  middle  of  a  sand  lot,  cannot  be 
kept  reasonably  free  from  dirt  and  dust;  the  grounds  have  neither 
trees  nor  grass  and  are  too  small  for  play  purposes.  And,  as  is 
very  commonly  the  case  in  village  and  rural  schools,  the  toilets 
are  a  disgrace  to  a  civilized  community. 

Discussion 
A  few  observations  concerning  the  adaptation  of  the  course  of 
study  to  the  intelligence  of  the  pupils  are  pertinent.     As  shown 
in  Table  I,  the  pupils  of  the  school  are  distributed  as  follows  in 
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regard  to  mentality;  imbecile,  1;  moron,  8;  borderline,  8;  dull,  42; 
normal,  34;  above  normal,  20.  The  imbecile  cannot  profit  by  the 
work  of  the  school  and  should  not  be  in  this  school  at  all.  The 
morons  cannot  learn  enough  reading  and  arithmetic  to  be  of  par- 
ticular value  to  them.  Although  they  might  be  taught  to  do 
simple  forms  of  mechanical  work,  no  opportunity  is  offered  in  this 
field.  The  borderline  cases  may  profitably  be  taught  reading, 
writing,  and  the  fundamental  operations  and  very  simple  fractions 
in  arithmetic.  They  might,  if  given  the  opportunity,  acquire  con- 
siderable skill  in  certain  kinds  of  industrial  work,  but  the  school 
offers  nothing  in  this  field.  The  dull  pupils  may  profit  by  much 
that  is  found  in  the  ordinary  course  of  study,  but  additional  time 
and  considerable  work  of  an  industrial  character  should  be  given 
them.  Finally,  no  provision  whatever  is  made  for  the  pupils 
above  normal;  these  receive  the  same  training  as  those  of  lower 
mentality.  It  is  thus  clear  that  within  this  school  there  is  iden- 
tity of  opportunity,  but  nothing  that  resembles  equality,  as  far  as 
providing  for  the  different  levels  of  mentality  is  concerned. 

The  fact  that  more  than  one-half  of  the  pupils  speak  a  foreign 
language  in  the  home  presents  a  difficult  problem,  particularly 
from  the  standpoint  of  teaching  citizenship.  In  these  homes 
scarcely  any  reading  material  is  found  except  the  foreign  press, 
and  this  is  often  hostile  to  the  institutions  of  our  country.  The 
pupils  of  this  school  are  taught  citizenship — if  it  may  be  digni- 
fied by  this  term — in  the  same  way  as  children  of  the  thoroughly 
American  home;  that  is,  they  are  taught  a  few  dates  in  history, 
more  or  less  disconnected  facts  about  the  government,  the  names 
of  the  presidents,  and  other  points  which  are,  for  the  most  part, 
memorized  with  but  little  appreciation  of  their  meaning.  In 
order  to  exert  a  greater  influence  upon  these  pupils,  the  work  of 
the  school  should  be  extended  to  the  home;  the  parents  as  well  as 
the  pupils  should  be  taught  to  read  and  to  speak  the  English 
language.  This  would  insure  a  type  of  reading  matter  more 
genuinely  American  for  the  home,  and  would  develop  a  more  fav- 
orable attitude  towards  America  and  things  American.  The  school 
in  some  of  the  more  progressive  communities  is  taking  the  initia- 
tive in  developing  such  an  attitude,  but  in  this  village  nothing  is 
done  in  that  direction,  consequently  the  children  (as  well  as  the 
community  and  the  state)  suffer.    That  is,  the  child  of  the  immi- 
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grant  is  not  afforded  an  equal  opportunity  with  the  native  child 
to  become  a  good  citizen. 

When  we  examine  the  teachers,  equipment,  and  building,  we 
find  scarcely  a  shadow  of  either  equality  or  identity  of  opportun- 
ity, in  comparison  with  the  opportunity  afforded  by  the  better 
schools  of  today.  In  the  latter  the  teachers  are  mature  and  well 
trained;  and  they  employ  much  of  the  best  material  and  most 
effective  methods  known  to  the  educational  world.  The  build- 
ings are  clean,  well  lighted,  properly  ventilated,  and  attractive; 
and  the  teaching  equipment  is  modern  and  adequate.  But  in 
this  village  almost  everything  that  goes  to  make  up  a  modern 
school  is  lacking.  Both  building  and  equipment  are  wholly  in- 
adequate for  obtaining  the  best  results,  and  the  majority  of  the 
teachers  are  immature  and  lack  training.  The  pupils  of  this 
school  are,  therefore,  clearly  at  a  disadvantage  with  those  of  many 
other  schools. 

Although  this  village  school  is  somewhat  exceptional  in  re- 
gard to  the  mentality  and  nationality  of  its  pupils,  it  is  not  un- 
usual in  other  respects.  It  represents  a  common  type  found 
throughout  the  United  States.  The  cause  of  such  conditions  is 
chargeable  chiefly  to  one  of  our  false  notions  of  educational  de- 
mocracy, namely,  the  complete  control  of  schools  by  local  author- 
ities. The  remedy  lies  in  the  creation  of  a  larger  taxing  unit;  in 
adequate  supervision  by  the  county  or  state;  in  giving  authority 
to  the  county  superintendent  (who  must  be  free  from  political 
influence)  to  name  or  to  nominate  teachers;  and  in  providing  a 
central  officer  to  condemn  buildings  and  to  prescribe  modern 
types,  without  endangering  his  position  through  any  sort  of 
political  chicanery. 
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THE  USE  OF  MEASUREMENTS  IN  A  SMALL  CITY 
SCHOOL  SYSTEM 

E.   E.   Keener 
Director,  Educational  Research,  Richmond,  Indiana 

Up  to  the  present  time  the  measurement  of  the  product  of 
education,  in  most  cases,  has  been  left  to  the  research  student  or 
to  the  school  administrator.  The  results  have  been  used  either 
for  writing  theses  on  educational  research,  or  for  showing  the  sup- 
erintendent or  principal  the  condition  of  a  school  or  class  with 
reference  to  a  set  standard.  The  systematic  use  of  standardized 
tests  as  a  direct  aid  in  teaching  has  been  very  limited.  The  class- 
room teacher  has  been  unable  to  see  the  value  of  such  measure- 
ments, not  only  because  she  knows  little  of  the  principle  of 
measurements,  but  also  because,  as  often  happens,  she  does  not 
even  see  the  results  of  tests  given  to  her  pupils.  Frequently,  there- 
fore, the  teacher  after  scoring  tests  according  to  definite  instruc- 
tions, turns  over  the  results  to  some  one  higher  in  authority 
without  herself  making  any  practical  application  of  them. 

Consequently  many  teachers  have  come  to  look  on  standard 
measurements  as  something  which  involves  a  great  deal  of  extra 
work  for  themselves,  and  which  seems  to  be  of  no  practical  value 
to  anyone.  Again,  teachers  who  have  had  the  meaning  of  scores 
explained  to  them,  often  raise  the  objection  either  that  these 
scores  do  not  give  any  additional  information  concerning  the  pu- 
pils or  that  they  are  so  unreliable  as  to  be  of  little  value.  Speak- 
ers at  educational  gatherings  frequently  emphasize  the  fact  that 
it  is  useless  to  give  tests  unless  something  is  done  about  them 
afterward;  but  they  fail  to  say  specifically  what  should  be  done. 

In  beginning  the  systematic  use  of  measurements  in  any  school 
system,  the  necessity  for  gaining  the  cooperation  of  the  teachers 
is  evident.  With  this  in  mind  a  department  of  measurements  was 
established  in  the  Richmond,  Indiana  public  schools  in  the  fall 
of  1919.  The  director  of  the  work  was  also  part-time  principal 
of  one  of  the  grade  buildings.  The  aim  of  the  department  was 
to  make  standard  tests  available  for  the  classroom  teacher,  and 
to  show  her  specifically  how  the  results  could  aid  in  teaching. 
Since  both  educational  and  mental  measurements  were  used 
(each  as  a  supplement  to  the  other),  they  will  be  discussed  to- 
gether. 
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Testing  was  not  forced  on  any  school  or  on  any  teacher,  but 
announcement  was  made  that  tests  and  information  concerning 
them  would  be  supplied  when  called  for.  At  first  there  was  little 
response.  In  the  beginning  therefore,  the  work  was  carried  on 
chiefly  at  Baxter  School  over  which  the  director  had  supervision. 
A  group  intelligence  test  was  given  to  all  the  children  in  this  school, 
and  the  Binet  test  was  given  to  the  very  bright  and  to  the  very 
dull  children.  The  Courtis  Silent  Reading  Test  and  the  Woody 
Arithmetic  Scale,  Series  A,  were  also  used  in  the  proper  grades. 

The  pupils  who  made  high  scores  on  both  the  intelligence  and 
the  educational  tests  were  allowed  to  advance  more  rapidly  than 
the  normal  rate  of  progress.  Several  did  three  half  grades  in  one 
year.  Those  who  were  very  dull  were  given,  as  nearly  as  possible, 
work  suited  to  their  ability.  The  ratings  secured  from  these 
tests  enabled  the  teachers  to  see  each  child  as  an  individual  prob- 
lem and  to  aid  him  in  overcoming  his  peculiar  difficulties.  "The 
greatest  good  to  each  pupil"  thus  becomes  the  slogan  instead  of 
"the  greatest  good  to  the  group." 

In  the  first  three  grades  the  pupils  were  grouped  according 
to  ability  in  the  different  subjects.  Both  the  educational  and 
the  intelligence  tests  were  used  to  make  these  groups  as  homo- 
geneous as  possible  in  ability.  A  pupil  was  sometimes  in  the 
highest  group  in  reading  and  in  the  average  group  in  arithmetic. 
The  grouping  was  always  kept  flexible  so  that  a  child,  whose  im- 
provement in  any  subject  justified  promotion,  could  be  advanced 
to  the  next  higher  group.  The  brightest  pupils  were  given  more 
work  than  the  average  or  slow  pupils,  and  were  often  used  as 
leaders  for  the  slower  pupils.  A  child  of  inferior  ability  was  not 
expected  to  do  average  work.  An  effort  was  made  to  keep  each 
child  working  up  to  the  level  of  his  capacity.  In  the  upper  grades 
the  pupils  of  very  low  ability  were  sometimes  excused  from  the 
less  essential  subjects  like  history  and  geography;  and  they  were 
allowed  to  spend  an  extra  amount  of  time  on  English,  reading, 
writing,  and  arithmetic. 

Long  before  this  work  in  the  Baxter  School  had  been  as  thor- 
oughly organized  as  has  been  described  above,  teachers  and  prin- 
cipals in  other  schools  began  to  be  heard  from.  They  first  asked 
that  individual  mental  tests  be  given  to  those  children  who  were 
especially  poor  in  their  work.  When  this  request  was  complied 
with,  some  of  these  children  were  found  to  be  subnormal;  and 
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others  were  found  to  be  normal  but  lacking  in  push  and  determi- 
nation. When  the  teachers  learned  the  difficulty,  they  were  en- 
abled better  to  deal  with  each  child  as  an  individual  problem. 

Soon  requests  from  the  various  schools  for  group  mental  and 
educational  tests  became  so  numerous  that  it  was  decided  to  ex- 
tend the  tests  over  the  whole  city,  provided  there  was  no  serious 
objection  among  the  principals  or  teachers.  The  intelligence 
tests  used  were  the  Pressey  Primer  Scale  and  the  Pressey  Cross-out 
tests.  The  educational  tests  were  the  Courtis  Silent  Reading 
Test  and  the  Woody  Arithmetic  Scale. 

In  order  to  "sell"  this  work  to  the  teachers,  a  meeting  was 
held  in  each  school  building.  The  value  of  the  tests  as  an  aid 
in  understanding  the  child  as  an  individual  problem  and  in  group- 
ing pupils  according  to  ability  was  discussed.  The  diagnostic 
value  of  educational  tests  was  stressed  as  of  especial  importance. 
The  use  of  the  results  in  comparing  one  class  with  another  and  with 
a  standard  was  also  emphasized.  The  limitations  of  existing  tests 
as  absolutely  accurate  means  of  measuring  a  child's  ability  at 
any  one  time  without  regard  to  temporary  conditions  was  ex- 
plained. The  teachers  were  told  to  use  caution  in  forming  any 
definite  and  far-reaching  conclusion  from  the  results  of  any  one 
or  two  tests.  The  results  from  all  the  tests,  both  educational  and 
mental,  combined  with  their  own  judgments  and  the  opinions  of 
superiors  must  be  taken  into  consideration. 

These  suggested  applications  of  the  tests  were  carried  out  to 
some  extent  in  all  buildings,  but  by  some  teachers  much  more 
than  by  others.  The  attitude  toward  the  principle  of  testing  is 
highly  gratifying.  All  teachers  in  the  city,  so  far  as  I  know,  are 
now  advocates  of  intelligence  and  educational  ratings  as  an  aid 
in  fitting  methods  of  instruction  to  the  needs  of  pupils.  This  re- 
sult of  the  first  year's  work  alone  was  well  worth  the  time  and 
money  which  has  been  spent  in  establishing  the  system  in  the 
schools  of  Richmond.  It  paved  the  way  for  an  organized  and 
widespread  system  of  procedure  in  1920-1921. 

During  1919-1920  group  intelligence  tests  were  given  to  prac- 
tically all  children  from  the  first  grade  through  the  junior  high 
school,  and  the  Binet  test  was  given  to  about  160  pupils.  Most  of 
the  pupils  who  were  given  individual  examinations  were  selected 
from  those  who  were  very  poor  in  their  work  and  who  scored  very 
low  on  the  group  test.    Twenty-seven  were  found  to  have  I.  Q.'s 
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of  69  or  below.  This  means  that  the  highest  of  this  group  will 
probably  never  develop  beyond  the  mental  level  of  eleven  years — 
i.  e.,  beyond  ability  to  do  fifth-  or  sixth-grade  work — in  the  same 
time  that  the  normal  child  would  finish  high  school.  Thirty 
made  a  score  of  70-79  I.  Q.,  which  means  that  the  highest  of  this 
group  will  probably  never  rise  above  the  mental  level  of  normal 
children  of  twelve  or  thirteen  years.  There  were  many  other 
pupils  in  the  system  who  would  have  made  similar  scores,  but  who 
were  not  examined  because  of  lack  of  time.  There  are  without 
doubt  some  errors  in  these  scores,  but  it  is  certain  that  a  large 
majority  of  these  pupils  will  never  be  able  to  do  the  regular  school 
work,  and  that  they  will  always  be  a  serious  problem  in  the  classes. 
A  special  school  should  be  established  for  these  children  where  they 
can  be  taught  the  essentials  in  reading,  arithmetic,  writing,  lan- 
guage, music,  and  hygiene.  But  much  of  their  time  should  be  spent 
in  some  kind  of  manual  training  which  will  prepare  them  better 
to  meet  life  in  the  outside  world  and  to  become  self  supporting. 

The  Courtis  Silent  Reading  Test  was  used  in  grades  iiib  to 
VIA,  and  the  Woody  Arithmetic  Scale  in  grades  ivb  to  viiib.^ 
In  a  number  of  classes  these  tests  were  given  two  or  three  times 
in  order  to  measure  improvement  and  the  effect  of  special 
methods  of  teaching.  Other  tests  were  used  in  smaller  numbers 
with  various  classes. 

The  application  of  test  results  may  be  illustrated  by  giving 
some  specific  instances  in  which  tests  were  of  special  value  to 
teachers  and  pupils.  In  one  second  grade  the  intelligence  tests 
showed  that  the  pupils  ranged  from  moron  to  very  superior  in 
ability.  They  were  arranged  into  groups  as  homogeneous  as 
possible  taking  into  account  the  results  of  the  tests,  the  scholar- 
ship records,  and  the  judgment  of  the  teacher.  The  members  of 
the  slowest  group  learned  much  more  rapidly  when  taken  from  the 
regular  classes.  One  boy  with  an  I.  Q.  of  52  had  been  in  school 
for  a  number  of  years  without  being  able  to  read  at  all.  In  a  group 
where  other  children  were  not  greatly  superior  to  him,  he  learned 
to  read  easy  material.  Until  this  arrangement  was  made  the 
teaching  went  entirely  over  his  head.  On  the  other  hand,  the 
brightest  group  did  much  more  than  the  normal  amount  of  work 
for  the  second  grade.  Six  of  the  brightest  pupils  were  put  into 
the  next  higher  grade,  and  their  present  success  indicates  that 
they  will  continue  to  advance  at  more  than  the  normal  rate. 

*  At  Richmond,  Section  B  is  low  and  Section  A  high  in  each  yearly  grade. 
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The  Courtis  Silent  Reading  Test  was  given  to  a  very  slow  iiib 
class  four  times.  It  was  given  in  October,  January,  March,  and 
May.  The  score  for  the  four  tests  was  as  indicated  in  the  follow- 
ing table: 


Test 

1 

2 

3 

4 

Speed 

Questions 

Comprehension 

90 
12 

35 

75 
16 
50 

105 
14 
80 

150 
25 

85 

These  results  include  only  the  scores  of  the  children  who  were 
there  for  all  four  tests.  After  each  test  the  class  was  divided 
into  three  groups:  the  first,  below  standard  both  in  speed  and 
comprehension;  the  second,  below  in  speed  only;  the  third,  below 
in  comprehension  only.  With  this  arrangement  the  teacher  was 
able  to  give  to  each  child  the  special  work  he  needed.  The  class 
in  June  scored  above  standard  in  all  points.  This  increase  in 
ability  could  not  have  been  accomplished  by  teaching  the  class 
as  a  whole,  or  by  grouping  the  pupils  without  regard  to  their  in- 
dividual needs.  The  children  of  this  class  knew  the  standard 
score  for  their  grade  and  whether  their  own  score  was  above  or 
below  it.  The  fact  that  they  knew  this  helped  them  to  work  more 
intelligently  to  overcome  their  own  difficulties.  The  teacher  of 
this  class,  though  skeptical  as  to  the  value  of  tests  at  the  begin- 
ning of  the  year,  is  now  an  enthusiastic  advocate  of  them. 

There  are  a  number  of  instances  where  the  tests  were  of  special 
value  to  certain  children.  An  over-age  girl  in  the  ia  grade  made 
a  very  high  score  in  reading.  She  was  skipped  to  the  iia  grade 
and  continued  to  do  good  work  in  reading.  If  her  record  is  main- 
tained she  will  be  skipped  again  and  work  off  her  retardation. 

A  third-grade  boy  was  unable  to  make  any  score  on  the  Gray 
Oral  Reading  Test.  Since  he  was  suspected  of  being  feeble- 
minded, he  was  given  the  Binet  test.  This  test  showed  him  to 
be  normal  mentally;  and  accordingly  further  effort  was  made  to 
find  the  cause  of  his  poor  reading.  His  eyes  were  tested  with  the 
letter  chart  and  seemed  normal.  When  questioned,  however,  he 
reported  that  the  letters  looked  as  if  "someone  had  put  a  wet 
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blotter  on  the  book"  and  blurred  them.  His  eyes  were  treated  and 
fitted  with  glasses;  and  at  the  close  of  the  year  he  scored  39  on  the 
Gray  Oral  Reading  Test. 

K.  T.,  a  boy  six  years  seven  months  old,  was  in  the  ia.  His 
mental  age  was  found  to  be  seven  years  ten  months;  and  his  I.  Q. 
was  therefore  119.  His  score  on  the  Gray  Oral  Reading  Test  was 
63,  which  is  much  above  standard.  He  was  promoted  to  the  iia 
and  did  above  average  work.  He  was  promoted  to  iiia  at  the 
close  of  the  year. 

F.  A.,  a  boy  in  grade  iia,  was  eleven  years  old.  He  was 
found  to  have  a  mental  age  of  nine  years  three  months.  His  I.  Q. 
was  84.  He  was  suspected  of  being  feebleminded,  but  was  really 
only  slightly  below  normal.  He  was  promoted  to  ivb  grade  and 
passed. 

The  chief  value  of  the  work  in  measurements  for  the  year  was 
that  the  teachers  came  to  accept  such  measurements  as  of  assis- 
tance in  understanding  children  as  individual  problems,  in  group- 
ing children  according  to  ability,  and  in  establishing  more  or  less 
definite  standards  of  attainment.  Data  were  gathered  to  show 
the  need  of  special  classes  for  the  subnormal.  If  these  classes  are 
established,  the  regular  teachers  will  be  relieved  of  their  most 
difficult  problems,  and  will  thus  be  enabled  to  give  more  time  to 
the  normal  pupils. 

The  work  of  the  department  in  the  future  will  be  to  organize 
the  system  so  as  to  make  possible  a  comparison  of  classes  and 
schools;  to  apply  the  results  in  such  a  way  as  to  afifect  methods 
of  teaching,  grouping  of  pupils,  and  modifications  in  the  course 
of  study;  and  to  have  direct  and  full  supervision  over  whatever 
special  schools  are  established,  deciding  which  pupils  are  to  be 
assigned  to  such  classes,  and  what  subjects  are  to  be  taught  in 
them.  The  director  should  have  authority  to  advise  on  special 
cases  of  double  promotions  and  of  failing  pupils.  The  results  of 
educational  tests  interpreted  in  the  light  of  mental  ratings  would 
be  very  valuable  in  checking  up  the  effectiveness  of  the  various 
experiments  in  methods  of  teaching.  Measurements  should  be 
extended  into  the  junior  and  senior  high  schools  where  grouping 
according  to  abiUty  is  possible  to  a  greater  extent  than  in  the 
grades.  In  order  to  carry  work  forward  effectively  every  effort 
must  be  made  to  obtain  the  good  will  and  cooperative  spirit  of 
teachers  and  principals. 


A  STUDY  IN  INTELLIGENCE  AND  EDUCATIONAL 
CORRELATIONS 

P.  F.  Valentine 
State  Normal  School,  Fresno,  California 

The  study  here  presented  was  carried  out  with  a  unit  group  of 
seventh-grade  pupils  in  one  of  the  public  schools  of  Fresno,  Cali- 
fornia.^ All  the  tests  were  given  during  a  term  of  twenty  weeks. 
Care  was  taken  throughout  to  preserve  uniform  and  normal  con- 
ditions, and  there  was  due  observance  of  the  instructions  pertinent 
to  the  standard  tests.  The  investigators  had  much  previous  ex- 
perience in  giving  and  scoring  the  various  tests.  Their  purpose 
was  to  examine  the  reliability  of  the  Binet-Simon  Intelligence 
Test  and  the  Otis  Group  Intelligence  Scale  as  instruments  in  the 
adjustment  and  regrading  of  pupils. 

Ninety-eight  pupils  participated  in  the  experiment  and,  as  far 
as  possible,  were  given  each  of  the  following  tests:  Binet-Simon, 
Stanford  revision,  abbreviated  scale;  Otis  Group  Intelligence 
Scale;  Courtis  Standard  Research  Tests  in  Arithmetic;  Ayres 
Spelling  Scale,  columns  T  and  U,  dictated;  Trabue  Language 
Scale  C;  visual  vocabulary  by  the  Thorndike  Reading  Scale  B; 
comprehension  in  reading  by  the  Courtis  Silent  Reading  Test; 
writing  for  speed  by  the  Ayres  Scale,  Gettsburg  edition. 

Before  presenting  the  correlations  between  the  intelligence 
and  educational  tests,  it  is  interesting  to  note  the  extent  of  cor- 
relation between  the  Binet  and  Otis  tests.  This  is  indicated 
rather  roughly  in  Table  I.  The  figures  in  this  table  are  based  on 
the  intelligence  quotients  derived  from  the  respective  tests. 


TABLE  I.      COMPARISON    OF    RESULTS    FOR    THE    BINET-SIMON    AND 

OTIS  SCALES 


Tests 

Highest 
Score 

75-per- 
centile 

Median 

25-per- 
centile 

Lowest 
Score 

Average 

Binet-Simon 

133 

100 

89 

83 

56 

92.4 

Otis 

154 

103 

88 

67 

40 

87 

These  figures  indicate  a  close  correlation  mathematically,  es- 
pecially in  the  upper  range.    The  coefl&cient  of  correlation  is  0 .  70 

^  Tests  administered  by  Blanche  Cummings,  psychological  expert  in  the  public 
schools,  Fresno,  California. 
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by  the  Pearson  formula  (Probable  Error,  0.04).  This,  though 
unquestionably  high,  is  hardly  large  enough  to  prove  a  satisfac- 
tory general  uniformity.  This  condition  is  emphasized  by  an 
examination  of  the  rough  data  of  the  experiment,  presented  here 
only  in  part  (see  Table  II) .  In  these  data  a  number  of  wide  in- 
dividual discrepancies  occur,  which  may  be  due  in  some  part  to 
accidental  vicissitudes  in  giving  the  tests.  But  whatever  the 
cause,  it  is  patent  that  the  testimony  of  any  single  test  should  not 
be  taken  as  final  in  estimating  the  intelligence  of  an  individual. 

The  frequency  distribution  of  intelligence  quotients  derived 
from  each  of  the  tests  is  shown  on  Figure  1.  This  discloses  a 
wider  range  and  greater  irregularity  of  distribution  in  the  case  of 
the  Otis  test.  It  will  be  noticed  that  the  distribution  in  the  case 
of  the  Binet  test  is  of  fair  normality. 

Before  taking  up  the  educational  correlations,  a  word  should  be 
said  about  the  methods  of  scoring.  In  the  case  of  the  visual  vo- 
cabulary test,  the  first,  second,  eleventh,  and  twelfth  lines  were 
omitted.  The  score  was  determined  by  the  exact  number  of 
words  defined,  instead  of  by  the  method  of  inference  suggested  by 
Thorndike.  In  the  spelling  test,  columns  T  and  U  of  the  Ayres 
scale  were  separately  scored  on  the  basis^of  100  percent  for  per- 
fect, and  the  results  averaged. 

FIGURE    1.    COMPARATIVE    FREQUENCY   DISTRIBUTIONS    FOR    BINET 

AND  OTIS  TESTS 
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A  difl&culty  was  encountered  in  the  scoring  of  results  in  the 
four  fundamentals  in  arithmetic.    The  simple  and  commonly 
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practised  plan  would  have  been  to  score  each  individual  on  the 
number  of  "rights"  in  each  operation.  But  it  is  recognized  that 
there  are  two  elements  in  each  of  the  fundamental  processes,  rate 
and  accuracy,  or  "attempts"  and  "rights."  To  score  only  the 
number  right  would  have  been  to  ignore  the  element  of  rate. 
What  was  wanted  was  a  single  coefl&cient  to  indicate  true  ability, 
vrhich  is  relative  to  both  rate  and  accuracy.  To  have  derived 
such  a  coefl&cient  by  dividing  "attempts"  by  "rights"  would  have 

2  10 

been  inaccurate,  because  -  =  100%  as  does  — ,  although  the  per- 
formance in  one  case  is  five  times  greater  than  in  the  other  case. 

The  solution  was  to  draw  up  a  chart  of  ascending  values,  a 
portion  of  which  is  illustrated  below.  The  numerator  of  the 
fraction-like  expression  indicates  the  number  of  examples  at- 
tempted, and  the  denominator  the  number  right.  The  figure  to 
the  right  of  each  expression  is  the  score  for  the  performance  indi- 
cated by  the  expression.     The  complete  chart  was  extensive  enough 

24 
to  measure  the  best  possible  performance,  i.  e.,  — .    The  same  form 

was  used  in  scoring  all  four  arithmetical  processes.  The  following 
portion  of  the  chart  illustrates  the  principle  according  to  which 
it  was  constructed: 
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An  examination  of  the  chart  may  disclose  some  apparent  dis- 
crepancies. For  example,  are  we  justified  in  giving  a  small  score 
to  no  attempts  and  no  rights,  and  a  zero  score  to  six  attempts  and 
no  rights?  The  principle  of  the  scale  demands  this  condition  at 
its  lower  extreme;  but  it  can  well  be  justified  by  the  assertion  that 
it  is  better  to  know  nothing  and  to  know  that  you  know  nothing, 
than  to  know  nothing  and  to  think  that  you  know  something. 
But  again,  are  we  justified  in  giving  a  higher  score  to  six  attempts 
and  three  rights  than  to  two  attempts  and  two  rights?  And  if  we 
are  so  justified,  then  how  about  giving  a  larger  score  to  two  at- 
tempts and  two  rights  than  to  six  attempts  and  two  rights?  Can 
we  say  that  power  in  addition,  for  example,  ascends  in  this  order: 
6/2,  2/2,  6/3?  It  must  be  admitted  that  there  is  some  interest- 
ing ground  here  for  debate;  but  to  the  writer  the  assumption  seems 
reasonable.  We  must  point  out  that  some  of  the  following  com- 
putations show  as  great  correlation  between  intelligence  and 
arithmetic  as  here  scored,  as  between  intelligence  and  some  of 
the  other  educational  subjects.  Further,  it  must  be  noted  that 
the  chart  is  a  regular  ascending  scale  from  the  poorest  performance 
to  the  best.  The  plan  is  presented  for  what  it  is  worth,  and  criti- 
cism is  invited. 

Table  II  shows  how  the  rough  data  were  arranged  for  the  pur- 
pose of  studying  the  correlative  positions  of  the  various  scores. 
In  all,  there  are  four  such  tables,  but  only  one  of  them — the 
smallest — is  reproduced  here.  The  method  of  arrangement  in 
these  tables  demands  a  careful  explanation.  The  study  is  one  of 
rank  correlation,  and  the  procedure  was  as  follows.  The  mental 
ages  derived  from  the  Binet  tests  were  placed  in  a  vertical  range 
from  the  highest  to  the  lowest,  equal  ages  being  placed  in  parallel. 
The  entire  range  was  found  to  be  from  nine  and  a  half  years  to 
fifteen  years.  This  range  was  divided  into  four  equal  parts.  It 
was  then  found  that  9  pupils  fell  into  quarter  1,  which  was  the 
highest  quarter;  35  fell  into  quarter  2;  29  into  quarter  3;  and  22  in- 
to quarter  4.  The  nine  pupils  who  fell  into  quarter  1  were  en- 
tered on  Table  II.  The  scores  of  these  same  pupils  in  the  Otis 
and  various  educational  tests  were  then  ranged  and  divided  into 
quarters  in  the  same  manner  as  just  explained  for  the  Binet  test. 
The  table  finally  showed  not  only  the  scores  but  the  number  of 
the  quarter  into  which  each  score  fell,  for  each  of  the  nine  pupils 
respectively,  in  each  subject.    This  same  method  of  tabulation 
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was  followed  for  the  pupils  falling  into  each  of  the  other  quarters 
by  Binet  mental  age,  thus  producing  four  tables. 

The  preliminary  theory  was  that  pupils  falling  into  quarter  1 
by  mental  age  should  tend  to  fall  into  the  corresponding  quarter 
in  the  educational  subjects;  that  those  falling  into  quarter  2  by 
mental  age  should  tend  to  fall  into  quarter  2  in  the  educational 
subjects;  and  so  for  the  pupils  in  the  other  two  quarters.  But 
there  is  a  fallacy  in  this  simple  scheme  for  studying  correlations ; 
for  example,  a  child  may  score  close  to  the  bottom  of  quarter  1  in 
mental  age  and  near  the  top  of  quarter  2  in  addition,  and  his  ac- 
tual correlation  in  that  case  would  be  closer  than  that  of  a  pupil 
who  fell  near  the  top  of  quarter  1  in  mental  age  and  near  the  bot- 
tom of  quarter  1  in  addition.  This  factor  is  inherent  in  the  en- 
tire scheme,  and  practically  negates  the  plan  unless  we  provide  a 
correction  in  our  calculations. 

In  the  matter  of  this  correction,  consider  the  group  of  pupils 
who  fall  into  quarter  2  mental  age.  All  of  them  who  fall  into 
quarter  2  in  all  the  educational  subjects  show,  for  our  purposes,  a 
perfect  correlation.  But  the  pupils  in  the  lower  half  of  quarter  2 
mental  age  may  rightfully  claim  correlation  with  educational  sub- 
jects to  the  extent  that  they  fall  into  the  upper  half  of  quarter  3  in 
those  subjects.  And  the  pupils  in  the  upper  half  of  quarter  2  mental 
age  may  claim  correlation  with  educational  subjects  to  the  extent 
that  they  fall  into  the  lower  half  of  quarter  1  in  those  subjects. 
To  figure  the  total  correlations  for  the  pupils  in  quarter  2  mental 
age,  we  might  count  the  number  of  times  the  educational  scores 
rank  in  the  identical  group,  and  add  half  the  times  that  educa- 
tional scores  rank  in  contiguous  groups.  This  is  admittedly  a 
loose  and  a  too  liberal  makeshift.  To  be  true  to  the  actual  mathe- 
matical probabilities,  we  should  have  to  take  somewhat  less  than 
half  the  correlations  with  contiguous  quarters  although  the  diff- 
erence would  in  fact  affect  our  results  but  slightly.  Our  correc- 
tion approximates  the  true  condition. 

The  correction  just  explained  applies  to  mental-age  quarters 
2  and  3.  But  since  mental-age  quarters  1  and  4  have  each  but 
one  contiguous  group,  we  may  add,  in  each  of  these  cases,  all  the 
times  that  educational  scores  rank  in  the  contiguous  group. 

Thus  for  each  mental-age  quarter  or  group  we  allow  a  leeway 
for  overlapping  equivalent  to  one-quarter  the  range  in  each  edu- 
cational subject.  The  corrections  as  here  explained  mil  be  made 
in  the  computations  that  follow. 
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Table  III  shows  the  frequencies  of  correlation  with  the  nine 
educational  subjects  for  the  pupils  in  the  respective  mental-age 
quarters  according  to  the  Binet  test.  The  second  vertical  column 
contains  the  nine  pupils  who,  as  already  mentioned,  fell  into  men- 
tal-age quarter  1.  The  table  discloses  that  three  of  these  corre- 
lated by  rank  with  two  educational  subjects,  one  of  them  with 
three  educational  subjects,  one  with  four,  one  with  five,  one  with 
six,  and  two  with  seven.  So  for  each  of  the  mental-age  quarters. 
Only  pupils  taking  all  the  tests  were  counted.  For  the  entire 
number  it  is  found  that  the  median  number  of  educational  sub- 


TABLE  III.      FREQUENCIES  OF  CORRELATION  OF  EDUCATIONAL  SUB- 
JECTS WITH  STANFORD-BINET  INTELLIGENCE  TEST  FOR 
EACH  MENTAL-AGE   QUARTER 


No.  OF  Edu- 
cational 
sxtbjects 
Corre- 
lating 

No.  OF 

Pupils  Correlating 

Quarter 
1 

Quarter 
2 

Quarter 
3 

Quarter 
4 

Totals 

1 

0 

0 

0 

2 

2 

2 

3 

1 

0 

6 

10 

3 

1 

3 

3 

4 

11 

4 

1 

3 

9 

2 

15 

5 

1 

10 

5 

2 

18 

6 

1 

8 

4 

2 

15 

7 

2 

3 

0 

0 

5 

8 

0 

0 

0 

0 

0 

9 

0 

0 

0 

0 

0 

Totals 

9 

28 

21 

18 

76 

Table  reads  (second  line) :  Of  the  9  pupils  in  the  first  mental-age  quarter,  three 
showed  rank  correlation  with  performance  in  two  subjects;  of  the  28  pupils  in  the  second 
mental-age  quarter,  three  showed  rank  correlation  with  performance  in  three  subjects; 
etc. 
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Jects  correlating  with  mental  age  by  rank  is  4.5  or,  since  there  were 
nine  subjects,  a  correlation  of  50  percent.^ 

Table  IV  duplicates  the  method  of  Table  III,  except  that  the 
mental  ages  have  here  been  determined  by  the  Otis  group  test. 
The  median  number  of  educational  subjects  correlating  by  rank, 
for  the  entire  number,  is  4  or  44  percent. 

TABLE  IV.      FREQUENCIES  OF  CORRELATION  OF  EDUCATIONAL  SUB- 
JECTS   WITH    OTIS    GROUP    INTELLIGENCE    SCALE    FOR 
EACH  MENTAL-AGE  QUARTER 


No.  or  Edu- 
cational 
Subjects 
Corre- 
lating 

No.  or 

Pin>iLS  Correlating 

Quarter 
1 

Quarter 
2 

Quarter 
3 

Quarter 
4 

Totals 

1 

0 

0 

1 

2 

3 

2 

1 

0 

1 

2 

4 

3 

3 

1 

0 

3 

7 

4 

6 

2 

8 

4 

20 

5 

2 

9 

3 

2 

16 

6 

4 

3 

4 

2 

13 

7 

2 

1 

0 

0 

3 

8 

0 

1 

0 

0 

1 

9 

0 

0 

0 

0 

0 

Totals 

18 

17 

17 

15 

67 

It  would  seem,  from  this  study,  that  there  is  only  a  fair  re- 
lationship between  attainment  in  either  of  the  intelligence  tests 
and  attainment  in  the  educational  subjects  taken  as  a  whole,  not- 
withstanding the  contrary  testimony  of  various  investigations. 
Of  the  entire  number  of  possibilities  for  correlation,  only  50  per- 
cent of  them  were  realized,  even  after  allowing  for  the  correlation 

*This  percentage  statement  of  correlation  is  not  to  be  confused  with  the  coeffi- 
cient of  correlation.  The  above  is  simply  a  statement  of  the  amount  of  rank  correlation. 
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with  contiguous  groups  as  explained  in  a  previous  paragraph. 
From  the  present  testimony  there  is  not  even  the  expectation  that 
all  pupils  will  come  up  to  the  50  percent  correlation,  as  equal  num- 
bers will  fall  considerably  below  and  above  that  median.  The 
writer  admits  the  novelty  of  the  method  of  study  here  used,  and 
willingly  submits  the  question  of  its  validity  to  minds  trained  in 
the  science  of  statistical  research. 

It  might  be  suggested,  as  a  check  on  results,  that  we  take  only 
those  pupils  whose  mental-age  quarters  were  identical  for  the  two 
intelligence  tests,  and  that  we  compare  their  intelligence  rankings 
with  their  educational  rankings.  This  would  tend  to  obviate 
error  in  the  intelligence  tests.  For  such  an  analysis  see  Table  V. 
Of  28  pupils  who  fell  into  identical  mental-age  quarters,  this  table 
shows  how  many  of  them  found  a  rank  correlation  with  one  edu- 
cational subject,  how  many  with  two,  and  so  on.  The  median 
number  correlating  in  this  case  is  4.25,  or  a  correlation  of  47  per- 
cent. 


TABLE  V.      FREQUENCIES  OF  CORRELATION  OF  EDUCATIONAL  SUB- 
JECTS WITH  BINET  AND  OTIS  SCALES  WHERE  THE  LATTER 
WERE  IN  AGREEMENT  AS  TO  MENTAL-AGE  RANK 


No.  of  Educational 
Subjects  Correlating 

No. 
ing 

Pupils  Correlat- 
by  Mental-Age 
Rank 

1 

1 

2 

2 

3 

3 

4 

6 

S 

8 

6 

7 

7 

1 

8 

0 

9 

0 

Total 

28 
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We  may  next  take  up  the  question  of  how  each  educational 
subject  compared  separately  in  rank  with  mental  age.  Table  VI 
presents  this  comparison,  the  Binet  mental-age  rankings  being 
used.  We  might  here  have  expected  a  greater  correlation  for 
the  more  intellectual  subjects  than  for  those  representing  mere 
skill,  but  such  distinction  is  not  evident,  except  in  the  case  of 
language  which,  it  will  be  remembered,  was  measured  by  the 
Trabue  Completion  Scale.  Various  other  investigations  have 
shown  a  high  correlation  between  this  scale  and  certain  standard 
mental  tests,  a  fact  that  argues  well  for  the  validity  of  our  own 
investigation.  In  the  case  of  reading  comprehension,  we  should 
have  expected  a  high  correlation  if  the  Kansas  or  Monroe  reading 
test  had  been  used.  The  Courtis  test  is  in  fact  standardized  only 
through  the  sixth  grade,  and  the  indications  were  that  it  was  too 
easy,  in  its  intellectual  elements,  for  the  seventh.  Our  test  did, 
in  fact,  show  a  fair  range  of  performance,  but  the  variation  was 
probably  due  largely  to  sensory-motor  factors. 


TABLE  VI.      FREQUENCIES   OF  CORRELATION   OF   SEPARATE  EDUCA- 
TIONAL  SUBJECTS   WITH   MENTAL   AGE   BY   THE   BINET 

TEST 


b 

k 

I 

1 

t 
1 

> 

1 

1 

1 

1. 

1 
a. 

! 

No.  pupils  taking 

test 

93 

93 

94 

94 

89 

85 

87 

90 

89 

No.  of  correlations 

45 

45.5 

40.5 

45.5 

49 

43 

56.5 

46.5 

46.5 

Percent  of  correla- 

tion  

48 

48 

42 

48 

55 

50 

64 

51 

51 

The  conclusion  to  be  drawn  from  the  entire  study,  if  valid,  is 
not  encouraging.  The  tables  show  constantly  a  correlation  that 
may  be  expressed  as  50  percent,  which  means  this:  that  the  me- 
dian pupil  found  a  rank  correlation  with  educational  subjects  to 
the  extent  of  just  half  the  opportunities.    This  is  just  the  correla- 
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tion  that  would  fall  by  chance.  This  last  point  is  probable  by  the 
following  reasoning:  a  pupil  in  mental-age  quarter  2  would  corre- 
late with  addition,  for  example,  if  he  fell  into  quarter  2  in  that 
subject,  or  in  the  lower  half  of  quarter  1,  or  in  the  upper  half  of 
quarter  3.  In  other  words,  that  pupil  has  a  range  of  two  whole 
quarters  in  addition  in  which  to  be  marked  plus  in  correlation,  ac- 
cording to  our  scheme;  leaving  two  quarters  in  which  to  be  marked 
minus.  That  pupil  has  a  "fifty-fifty"  chance,  which  is  almost  ex- 
actly the  amount  of  correlation  that  our  investigation  showed  for 
the  median  pupil,  counting  all  subjects. 

We  began  this  experiment  with  the  purpose  of  testing  the 
validity  of  the  intelligence  scale  as  an  instrument  in  the  regrading 
and  regrouping  of  pupils.  If  our  conclusions  are  to  stand,  the 
verdict  must  be  colorless.  Our  results  at  any  rate  demonstrate 
that  it  is  a  dangerous  thing  to  take  the  testimony  of  any  single 
intelligence  test  as  final  proof  of  inferior  or  superior  capacities  in 
the  conventional  subjects.  There  is  at  present  a  tendency  to 
push  the  intelligence  tests  into  the  hands  of  unscientific  enthu- 
siasts throughout  the  teaching  force.  Although  these  people  may 
be  trained  in  the  accurate  administering  of  the  tests,  it  is  in  the 
uses  they  may  make  of  results  that  the  danger  lies. 


CHILD  ACCOUNTING 

Is  the  once  powerful  tribe  of  child  accountants  passing  off 
the  scene?  Assailed  by  hostile  forces,  is  it  like  a  nation  of  aborigi- 
nes dwindling  first  to  hundreds  and  then  to  scores  and  dozens 
and  finally  to  the  lone  survivor,  the  erstwhile  chief  of  a  forgotten 
clan? 

Twelve  or  fifteen  years  ago  child  accountants  were  first  coming 
into  prominence.  Those  were  the  days  of  the  Thorndike-Ayres- 
Falkner-Winship  controversy  over  elimination.  The  Psycho- 
logical Clinic  was  born  and  thrived  and  dwindled.  In  its  pages 
and  elsewhere  the  controversy  was  carried  on.  Thorndike  began 
it  with  his  cryptic  "The  Elimination  of  Pupils  from  School." 
Falkner  with  far  less  insight  but  with  rare  statistical  skill,  Ayres 
with  his  lucid  style  and  his  promise  of  better  things  statistically, 
and  Winship  with  his  rhetoric,  multiplied  evidence  and  generated 
heat  as  to  the  correctness  of  the  statement  that  only  40  percent 
of  the  pupils  who  enter  school  continue  to  the  eighth  grade.  The 
up-shot  of  the  controversy  seemed  to  be  that  you  couldn't  tell 
how  many  children  survive  to  each  grade  unless  by  individual 
record  cards  you  could  actually  trace  their  history  from  the  time 
they  entered  school.  As  far  as  we  know,  however,  such  a  study 
has  not  yet  been  made  despite  its  obvious  value. 

This  was  also  the  period  during  which  Dr.  Maxwell  of  New 
York  first  brought  forward  the  question  of  age  with  respect  to 
grade.  How  vividly  do  we  recall  the  attention  which  Dr.  Max- 
well's figures  attracted.  They  were  pronounced  at  conventions, 
printed  in  newspapers,  and  transmitted  by  word  of  mouth.  One 
superintendent  would  whisper  to  another,  "Have  you  heard  of 
the  awful  conditions  in  New  York?  Forty  percent  of  the  children 
are  too  old  for  their  grades!"  With  Pharisaical  satisfaction  yet 
gravely,  as  befitted  the  sad  occasion,  the  other  would  reply, 
"Yes,  the  school  conditions  in  New  York  are  very  bad;  but  then 
you  know  that  is  what  one  must  expect  when  politics  run  the 
schools."  Whereupon  the  two  would  no  doubt  fall  to  discussing 
the  Tweed  Ring  and  Boss  Crocker  and  Tammany  as  though 
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machine  politics  were  somehow  indigenous  to  the  metropolis. 
After  reading  the  report  of  Superintendent  Maxwell  or  perhaps 
after  hearing  it  discussed  at  an  N.  E.  A.  meeting,  other  superin- 
tendents, desiring  to  show  how  much  better  their  school  conditions 
were,  began  to  collect  the  information  as  to  the  ages  and  grades 
of  the  pupils  under  their  care.  Whereupon,  like  as  not,  in  one 
community  after  another  a  solemn  hush  ensued.  The  real  truth 
appeared  to  be  that  for  the  most  part  conditions  in  other  cities 
were  no  better  than  they  were  in  New  York.  Perhaps  they  were 
even  worse. 

As  a  result  of  the  ensuing  agitation  a  very  general  effort  was 
made  to  reduce  the  percent  of  over-ageness.  Very  likely  not  a 
little  energy  was  misdirected;  but  on  the  other  hand  it  is  almost 
impossible  to  overestimate  the  good  results  that  were  accom- 
pHshed.  The  number  of  elementary-school  graduates  practically 
doubled  in  the  ten  years  intervening  between  1908  and  1918, 
although  during  the  same  time  the  population  of  the  country 
increased  no  more  than  15  percent.  No  doubt  one  of  the  causes 
of  the  large  increase  in  the  number  of  graduates  was  the  effort  to 
reduce  over-ageness  throughout  the  country. 

With  the  appearance  of  standardized  tests  and  scales  and  the 
development  of  what  has  been  called  the  measurement  movement, 
the  activities  of  the  child  accountants  diminished.  Some  of  those 
who  had  been  engaged  in  counting  noses  now  began  to  count 
"attempts"  and  "rights."  Moreover,  as  new  students  of  education 
became  active,  they  tended  to  turn  away  from  child  accountancy 
and  to  busy  themselves  with  median  scores,  and  later  with  mental 
ages  and  intelligence  quotients.  In  other  words,  the  progressive 
school  people  and  the  research  workers  became  interested  in 
cultivating  a  new  field  to  the  neglect  of  the  old  one. 

We  make  no  secret  of  the  fact  that  we  think  this  is  unfortu- 
nate. Questions  of  enrollment  and  attendance  as  measures  of  the 
extent  of  school  service,  of  promotion  as  the  official  record  of 
accomplishment,  of  retardation  and  elimination  as  indices  of  the 
adjustment  of  means  to  ends  of  size  of  class,  length  of  school  term, 
and  teacher-to-pupil  ratio  as  criteria  of  organization  and  as  data 
for  use  in  computing  unit  costs — these  questions  have  independent 
as  well  as  relative  value. 

For  example,  in  a  certain  city  a  very  liberal  policy  of  promo- 
tion has  prevailed  for  several  years.    The  promotion  rate — ^i.e., 
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the  proportion  of  children  on  register  the  last  day  of  the  semester 
who  were  promoted  on  that  day — was  about  95  percent.  Not 
long  ago  a  testing  program  was  instituted  in  this  city.  It  involved 
the  use  of  two  or  three  standardized  subject-matter  tests  as  well 
as  a  mental  test.  The  results  showed  that,  according  to  grade 
standards  obtained  elsewhere,  the  pupils  in  this  city  were  not  up 
to  grade.  In  fact,  in  the  subject-matter  tests  they  were  fully  half 
a  year  behind  the  standards  pertaining  to  the  grades  in  which  they 
were  classified. 

On  the  other  hand,  the  children  were  relatively  young  for 
their  grades,  and  a  very  large  proportion  of  them  were  therefore 
completing  the  elementary  school  and  entering  high  school. 
Moreover,  when  the  achievements  of  the  pupils  in  the  subject- 
matter  tests  were  compared  not  with  grade  standards  but  with 
the  mental  ages  of  the  pupils — in  other  words,  when  achievement 
was  compared  with  what  the  endowments  of  the  children  would 
lead  one  to  expect  them  to  achieve — it  was  found  that  their  per- 
formance was  unusually  good. 

A  similar  testing  program  was  carried  out  in  another  city  of 
about  the  same  size  and  located  in  the  same  section  of  the  country. 
In  this  city  a  conservative  promotion  policy  was  in  effect.  Results 
obtained  on  the  subject-matter  tests  were  well  above  the  grade 
standards.  Nevertheless,  there  was  a  very  general  tendency  for 
children  to  be  too  old  for  their  grades.  Pupils  who  were  in  no 
way  defective  according  to  the  mental  test  were  two  and  three 
years  older  than  the  standard  ages. 

Now,  it  is  not  difficult  to  see  what  is  going  on  in  these  two  cities. 
In  the  city  we  have  first  mentioned,  grade  standards  are  sacrificed 
in  order  that  children  may  obtain  the  benefits  of  the  richer  cur- 
ricula of  the  upper  grades.  In  the  second  city  it  is  the  pride  of  the 
superintendent  that  no  pupil  transferred  from  his  school  system 
to  another  is  ever  reduced  in  grade.  Indeed,  he  reports  that  not 
infrequently  his  pupils  are  advanced  at  once  to  higher  grades. 

Which  of  these  superintendents  is  right?  Is  either  school 
system  properly  characterized  merely  by  the  results  of  a  testing 
program?  Do  we  not  need  the  supplementary  data  which  child 
accountancy  provides?  With  them  at  hand,  the  superintendent 
in  the  first  city  can  afford  to  continue  his  liberal  promotion  rate, 
take  his  losses  in  grade  standards,  and  successfully  maintain  that 
his  system  is  fulfilling  the  highest  purpose  of  a  school  system, 
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namely,  the  training  of  the  pupils.  On  the  other  hand,  with  the 
proper  "accounting"  of  the  children  the  superintendent  in  the 
second  city  will  be  revealed  as  paying  an  enormous  price  for  the 
satisfaction  of  maintaining  high  standards  in  the  grades.  Or, 
more  accurately,  it  is  the  children  who  are  paying  the  price  in 
wasted  time  and  lost  opportunity.  No  scheme  of  testing  children 
can  reveal  the  shortcomings  of  this  system,  for  the  tests  cannot 
be  given  to  the  children  who  are  not  there,  to  the  children,  in  other 
words,  who  should  be  in  school  and  are  not.  Moreover,  they  can- 
not be  given  to  the  children  who  should  be  in  the  seventh  or 
eighth  grade  when,  as  a  matter  of  fact,  they  are  in  the  fifth  or 
perhaps  in  the  fourth  grade. 

The  condition  is  somewhat  like  that  of  a  large  elementary 
school  in  a  certain  city  whose  pupils  on  entering  high  school  were 
found  to  be  much  stronger  in  English  than  the  pupils  coming  from 
other  elementary  schools.  After  observing  this  long  enough  to  be 
sure  that  it  was  really  a  permanent  condition,  the  high-school 
principal  sent  the  head  of  his  English  department  on  a  three-day 
visit  to  the  elementary  school  in  question  with  instructions  to  find 
out  how  these  results  were  accomplished.  At  the  end  of  the  first 
half  day  the  head  of  the  English  department  returned  and  re- 
ported that  he  had  found  out.  He  said  that  all  but  the  very  best 
were  killed  off  before  reaching  the  eighth  grade.  This  elementary 
school  had  an  enrollment  of  more  than  two  thousand  children, 
yet  it  had  but  one  class  of  upper  eighth-grade  pupils.  No  doubt 
the  precious  grade  standards  in  this  school  were  a  delight  to  the 
principal  and  teachers. 

But  one  is  impelled  to  ask  whether  schools  are  run  for  the 
purpose  of  maintaining  grade  standards.  If  they  are,  any  one 
can  have  a  good  school.  All  one  needs  to  do  is  to  make  promotion 
sufficiently  difficult  to  secure.  Under  these  circumstances  a  school 
becomes  a  ruthless  organization  in  which  unhappiness  and  failure 
are  the  lot  of  all  but  the  few  whose  survival  proclaims  them  the 
fittest.  We  are  of  the  opinion  that  the  schools  are  run  for  the  bene- 
fit of  the  children  rather  than  for  the  sake  of  standards.  It  is  our 
notion  that  the  promotion  of  a  child  is  to  be  decided  primarily  on 
the  basis  of  whether  he  will  benefit  more  by  advancement  than 
by  repeating  the  work  of  the  lower  grade.  Nor  is  the  question  of 
his  ability  to  benefit  by  the  advancement  to  be  decided  entirely 
on  the  basis  of  the  quality  of  work  done  in  the  lower  grade.    There 
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is  a  sense  in  which  a  higher  law  supervenes — the  law  in  virtue  of 
which  a  child  should  be  promoted  because  of  what  he  needs  to 
learn  rather  than  because  of  what  he  has  learned. 

In  our  judgment  we  need  a  revival  of  child  accounting.  We 
need  it  now  more  than  we  ever  did.  The  undoubted  advantages 
of  the  testing  movement  have  been  accompanied  by  some  abuses. 
Superintendents  and  teachers  are  between  the  horns  of  a  dilemma. 
On  the  one  hand,  grade  standards  ought  to  be  high;  on  the  other 
hand,  in  the  bookkeeping  of  the  school  the  accounts  of  pupils 
must  show  all  possible  progress.  No  estimate  of  the  efi&ciency  of  a 
school  system  is  complete  if  the  case  rests  solely  upon  the  results 
of  tests.  These  results  need  supplementing  in  many  ways,  and 
one  way  is  by  a  competent  accounting  of  children. 

B.  R.  B. 

CALIFORNIA 

The  citizen  of  California  may  boast  of  climate  and  citrous 
fruit;  and  in  so  doing  he  is,  no  doubt,  entitled  to  a  hearing.  To 
be  sure  he  is  a  bit  annoying,  but  this  is  rather  because  he  exercises 
no  restraint  than  because  he  hasn't  a  good  case.  But  a  far  more 
legitimate  source  of  state  pride,  though  less  often  vaunted,  is  the 
public  school  system.  Whether  the  Ayres  index  is  right  about  it 
or  not,  the  evidence  is  too  consistent  to  be  denied.  To  be  sure, 
California  still  has  some  relics  of  unregenerate  days  which  other 
states  have  disposed  of.  For  example,  she  must  still  be  listed  as 
under  the  district  system  of  local  control.  Moreover,  she  has  at 
the  top  both  a  superintendent  of  public  instruction  and  a  state 
board  of  education.  Even  in  these  respects,  however,  the  usual 
effects  are  largely  mitigated.  The  districts,  have  been  deprived 
of  many  of  the  powers  that  ordinarily  make  them  a  reactionary 
institution;  while  the  state  board  and  the  state  superintendent, 
because  of  fortunate  personalities,  get  along  together  very  much 
better  than  might  easily  be  the  case. 

But  with  a  few  exceptions,  which  will  doubtless  be  removed  in 
the  near  future,  the  California  system  as  a  going-concern  com- 
mands our  all  but  unqualified  respect. 

There  has  just  appeared  a  report  of  the  special  legislative 
committee  on  education,  appointed  by  the  California  legislature 
of  1919.  This  report  enters  into  the  existing  conditions  in  Cali- 
fornia and  gives  a  glimpse  of  their  historical  development.     It 
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then  lays  down  what  appear  to  the  committee  to  be  the  lines  along 
which  the  state  should  move  in  matters  educational.  The  com- 
mittee report  is  organized  about  four  problems  or  questions,  and 
to  each  of  these  a  chapter  is  given.  The  first  is  the  question  of 
educational  organization  with  particular  reference  to  district  and 
county  units.  The  second  is  the  problem  of  teacher  training,  both 
before  and  after  teaching  service  begins.  The  third  concerns  the 
high  school  and  junior  college,  and  the  fourth  the  cost  of  education. 

The  report  mentions  a  number  of  hearings  which  the  committee 
held,  but  it  is  impossible  to  distinguish  the  results  of  the  hearings. 
Professor  Cubberley  wrote  the  report,  and  it  is  evident  to  all 
students  of  education  that  it  strongly  embodies  his  ideas.  The 
committee  is  to  be  congratulated  on  its  good  sense  in  utilizing 
Professor  Cubberley's  ability.  If  one  were  censoriously  inclined, 
one  might  ask  why  the  committee  held  any  hearings  at  all — in 
short,  why  it  did  not  request  Professor  Cubberley  to  write  the 
report  at  once. 

To  anyone  who  is  interested  in  the  development  of  schools, 
not  only  in  California  but  elsewhere  throughout  the  country,  the 
passage  of  the  sixteenth  amendment  to  the  California  constitu- 
tion is  significant.  This  amendment  was  submitted  to  the  voters 
last  November  and  received  their  sanction.  It  adds  kindergartens 
to  the  public  school  system  and  provides  greatly  enlarged  state 
and  county  funds.  The  state  is  required  to  distribute  to  cities 
and  districts  an  amount  equal  to  thirty  dollars  per  pupil  in  average 
daily  attendance  in  the  public  elementary  and  secondary  schools, 
both  day  and  evening.  The  board  of  supervisors  of  each  county  is 
required  to  provide  an  equal  amount  for  each  pupil  in  average 
daily  attendance  in  the  public  elementary  schools  and  to  provide 
twice  as  much  money  for  each  pupil  in  average  daily  attendance 
in  the  public  secondary  and  technical  schools.  The  legislature  is 
also  required  to  provide  for  the  levying  of  local  district  taxes  for 
public  school  purposes.  Thus,  from  state  and  county  sources 
combined  a  minimum  of  sixty  dollars  per  elementary  school  pupil 
(day  and  evening)  and  a  minimum  of  ninety  dollars  per  secondary 
school  pupil  (day  and  evening)  is  provided.  These  amounts  are  in 
excess  of  the  average  per  capita  cost  of  elementary  and  high- 
school  instruction  even  in  progressive  communities.  Since  a 
district  tax  is  definitely  required,  the  added  amount  for  educa- 
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tional  purposes  is  sufficient  to  place   the   schools  of  California 
in  an  enviable  position. 

One  datum  on  this  point  may  be  of  interest.  The  school 
people  of  Illinois  are  asking  the  legislature  this  year  for  an  increase 
in  the  state  distributable  fund.  This  fund  now  amounts  to  six 
million  dollars — a  beggarly  amount  for  the  second  state  in  the 
Union  in  wealth.  Dr.  Carter  Alexander  lately  brought  this  out  in 
an  address  in  which  he  showed  that  if  Illinois  made  the  same  effort 
that  California  was  making  prior  to  the  adoption  of  the  sixteenth 
amendment  it  would  have  a  state  distributable  fund  of  twenty- 
three  million  dollars.  But  Cahfornia  has  not  been  content  with 
her  former  effort.  She  has,  by  referendum  vote  of  the  people, 
provided  a  state  distributable  fund — to  say  nothing  of  the  even 
larger  county  fund — which  is  75  percent  higher  than  the  former 
fund.  To  equal  this  Illinois  would  have  to  provide  a  fund  of 
forty  million  dollars — or  twice  the  amount  which  after  much 
hesitation  and  many  misgivings  the  Illinois  school  people  have 
ventured  to  request.  California  got  her  increase  from  the  people 
directly.  We  wonder  if  the  people  are  not  more  interested  in 
education  and  more  willing  to  make  sacrifices  for  it  than  most 
members  of  state  legislatures  are  aware.  We  wonder  in  other 
words  whether  the  schools  may  not  stand  a  better  chance  of 
favorable  treatment  at  the  hands  of  the  people  than  at  the  hands 
of  their  representatives.  In  any  event  recent  events  in  California 
should  be  brought  to  the  attention  of  state  legislatures  and  the 
"deadly  parallel"  should  be  drawn.  California  not  only  provides 
handsomely  for  her  schools  but  she  serves  magnificently  the  cause 
of  education  everywhere. 

B.  R.  B. 


S^ut^ms  an6  Abstrarts 

E.  H.  Cai£eron,  Editor 


Learned,  William  S.,  Bagley,  William  C,  and  McMurry,  Charles  A.,  Strayer, 
George  D.,  Dearborn,  Walter  F.,  Kandel,  Isaac  L.,  Josselyn,  Homer  W. 
The  professional  preparation  of  teachers  for  American  public  schools:  A  study  based 
upon  an  examination  of  tax-supported  normal  schools  in  the  state  of  Missouri. 
New  York  City:  The  Carnegie  Foundation  for  the  Advancement  of  Teaching, 
1920.   475  pp. 

When  this  investigation  was  first  projected,  it  was  planned  that  it  should  consist 
of  two  parts:  one  was  to  give  the  results  of  an  examination  of  all  institutions  in  the 
state  engaged  in  preparing  teachers  for  public  schools;  the  other  was  to  deal  with  the 
teaching  population.  This  volume  is  the  second  in  a  series  of  three  bulletins  dealing 
with  the  first  part  of  the  inquiry.  The  first  bulletin  attempted  to  answer  the  question : 
What  is  the  best  preparation  for  teaching?  It  consisted  of  a  set.  of  curriculums  for  the 
preparation  of  teachers.  The  present  volume  deals  with  the  educational  and  adminis- 
trative aspects  of  the  preparation  of  teachers  in  state  normal  schools.  The  third  will 
consider  the  work  of  colleges  and  universities  in  teacher  preparation. 

The  material  found  in  this  volume  is  an  exceedingly  valuable  contribution  to  the 
literature  bearing  upon  teacher  preparation,  for  it  represents  the  conclusions  drawn  from 
definite  facts  ascertained  by  competent  educational  authority.  Information  was 
secured  by  thorough  personal  inspection  and  investigation  on  the  ground  by  the 
members  of  the  survey  staff.  In  a  word,  this  investigation  represents  a  successful 
attempt  to  secure  the  facts  concerning  the  educational  side  of  the  work  of  Missouri 
normal  schools  and  methods  and  plans  of  organization  and  administration  of  these 
institutions,  and  to  draw  valid  conclusions  concerning  the  success  of  teacher  prepara- 
tion in  Missouri  which  could  be  justified  in  the  light  of  the  data  secured.  The  sur- 
veyors also  make  recommendations  for  future  procedure  which  seem  to  the  members 
of  the  staff  to  be  justified  in  the  light  of  the  conditions  existing  in  the  state. 

The  bulletin  covers  a  wide  range  of  topics,  all  of  which  are  of  vital  interest  to 
students  of  normal-school  organization  and  administration.  The  more  important 
are:  the  origin  and  growth  of  normal  schools  in  the  United  States  and  in  Missouri; 
government  and  control  of  Missouri  normal  schools,  with  suggestions  for  a  better 
organization  of  professional  preparation  for  teachers,  including  reorganization  of  state 
educational  control;  function  and  scope  of  organization  of  normal  schools;  personnel  of 
the  Missouri  normal  schools;  curriculums;  the  operation  of  normal  schools  with  refer- 
ence to  the  president  and  staff  and  to  the  administrative  treatment  of  student  body; 
the  product  of  the  normal  schools. 

The  reader  of  this  volume  is  impressed  with  the  earnestness  and  sincerity  of  the 
survey  staff,  the  courage  with  which  they  criticize  that  which  is  bad,  and  the  vision  of 
teacher  preparation  which  they  present. 

On  the  other  hand,  the  reader  is  equally  surprised  at  some  of  the  attitudes  taken, 
especially  that  toward  supervision.  These  investigators  frown  upon  present  methods 
and  attitudes  of  supervisors  of  schools.     Apparently  these  officers  would  become 
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superfluous  in  the  kind  of  schools  which  will  app>ear  when  teachers  are  properly  trained. 
In  such  schools 

the  pupfl  would  meet  directly  and  constantly  a  well-selected  and  tested  leader 
prepared  to  speak  irith  personal  effect  and  to  win  response  by  virtue  of  trained 
intelligence.  Such  leaders,  instead  of  taking  minute  orders  from  higher  oflScers, 
would  themselves  assume  the  responsibility,  in  joint  action,  for  the  conduct  and 
development  of  instruction — the  life-long  business  of  capable  minds.  In  other 
words,  education  would  become  a  first-hand  process  by  skilled  practitioners,  like 
any  other  professional  service,  instead  of  a  second  or  third  hand  operation  with  its 
consequent  perfunctory  effects. 

The  writer  of  this  review  believes  that  this  attitude  toward  supervision  is  unfortu- 
nate. It  is  doubtful  if  schools  can  ever  be  turned  over  to  a  body  of  teachers,  however 
well  trained,  each  of  whom  acts  upon  his  own  initiative,  without  effective  and  compe- 
tent leadership  and  without  efficient  organization.  The  management  of  a  school 
system  cannot  be  compared  with  the  private  practice  of  law,  medicine,  or  engineering. 
Nowhere  has  th  s  orm  of  conducting  an  enterprise  like  a  public  school  system  been 
found  possible.  The  reviewer  seriouslj'  questions  whether  this  could  be  done  in  a  sys- 
tem as  complex  as  modem  schools  have  become. 

Another  recommendation  which  seems  to  the  survey  staff  capable  of  remedying 
many  evils  of  the  Missouri  normal  schools  appear  to  the  reviewer  to  be  of  very  doubtful 
value.  State  normal  schools  as  separate,  individual  institutions  would  be  done  away 
with  and  the  normal-school  system  of  the  state  would  be  organized  under  a  single 
direct  on  as  a  part  of  an  enlarged  aid  reconstituted  state  university.  The  survey  staff 
canno  seem  to  entertain  he  idea  that  the  Missouri  normal  schools  can  succeed 
without  being  closely  connected  in  some  way  with  the  state  university.  It  seems  incon- 
ceivable to  thi  group  of  men  that  the  state  of  Missouri  can  maintain  five  state  teachers 
colleges  under  a  central  state  board  of  regents  with  a  competent  educator-executive  at 
the  head  of  each  institution  and  al  ow  the  state  university  also  to  maintain  its  existence 
with  a  competent  head  under  its  own  board  of  regents.  On  the  contrary,  finding  that 
the  university,  five  state  normal  schools  and  a  number  of  high  schools  with  teacher- 
training  classes  are  participating  in  the  work  of  preparing  teachers,  they  conclude  that 

There  can  be  no  reasonable  question  that  better  results  than  are  now  accom- 
plished under  these  several  managements  could  be  secured  under  one  control. 

It  is  not  clear  to  the  reviewer  that  the  state  would  act  wisely  by 

incorporating  the  present  normal  schools  together  with  the  university  school  of 
education  as  a  state  Division  of  Education  fully  organized  and  equipped  to  provide 
for  all  phases  of  the  professional  training  of  teachers  for  the  public  schools  of  the 
state.  The  normal  schools  would  thus  become  State  Colleges  of  Education  within 
the  university  and  subject  to  the  same  consideration  as  any  other  branches  of  that 
institution. 

That  the  state  normal  schoo's  of  Missouri  should  be  unified  under  one  board  and 
become  hiph  grade  state  colleges  is  entirely  clear.  But  why  should  they  be  "within  the 
imiversity  '?  The  reviewer  fails  to  see  why  a  state  like  any  of  the  great  states  of 
iht  central  west  cannot  maintain  half  a  dozen  efficient  state  teachers  colleges  with 
genuinely  collegiate  standards  and  requirements,  each  a  distinct  institution,  but  all 
under  a  properly  organized  board.  The  problems,  however,  involved  in  organizing  and 
conducting  a  great  university  are  so  complex  and  so  different  from  those  coimected 
with  organizing  and  administering  a  great  system  of  state  teachers  colleges  that  two 
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separate  and  distinct  boards  are  necessary  and  desirable.  With  an  ever-changing 
personnel  it  is  difficult  enough  for  a  group  of  executives  such  as  state  normal-school 
presidents,  to  familiarize  a  board  with  the  needs  of  one  group  of  institutions.  It  is 
usually  several  years  before  a  new  member  of  a  board  of  normal-school  regents  becomes 
thoroughly  familiar  with  the  workings  of  these  schools  and  arrives  at  an  understanding 
of  their  needs.  If  there  is  added  to  this  the  necessity  of  becoming  familiar  with  the 
requirements  of  a  great  university  with  all  of  its  varied  fields  and  activities,  the  task 
becomes  nearly  impossible.  For  these  reasons,  it  would  be  an  unwise  pohcy  of  state 
educational  administration  to  place  state  teachers  colleges  and  the  state  university 
under  one  board. 

Furthermore,  it  is  not  clear  that  a  university  college  of  education  can  or  should 
participate  to  any  great  extent  in  the  preparation  of  teachers  for  a  state.  This  is  the 
work  of  state  normal  schools.  The  college  of  education  in  the  vmiversity  has  a  different 
function. 

Without  doubt,  each  state  should  have  an  able  and  competent  superintendent  of 
public  instruction  who  might  be  ex  officio  president  of  both  the  normal-school  board  and 
the  university  board.  He  should,  at  any  rate,  be  the  most  influential  member,  the 
educational  advisor,  and  the  coordinator  of  these  boards. 

The  reviewer  seriously  questions  the  wisdom  of  consoUdating  all  the  teacher- 
preparation  agencies  of  he  state  under  one  direction,  subject  to  a  chancellor  of  the 
university  who  would  be  coordinate  with  the  commissioner  of  elementary  and  secondary 
education.  On  the  other  hand,  there  is  a  good  deal  of  experience  which  warrants  the 
view  that  separate  university  and  normal-school  boards  made  up  of  intelligent  public 
spirited  citizens  interested  in  education  with  the  state  superintendent  of  pubhc  instruc- 
tion as  the  educational  expert  of  each  board,  constitute  a  better  form  of  state  educa- 
fonal  organization.  Under  this  form  the  president  of  the  state  university  and  the 
president  of  each  state  teachers  college  would  have  equal  rank  and  all  would  recognize 
the  state  superintendent  as  their  superior  officer.  The  reviewer  emphatically  dissents 
from  the  view  that  the  great  system  of  state  teachers  colleges  such  as  that  which 
Missouri  should  have  can  succeed  only  if  made  a  part  of  the  state  university  and  con- 
trolled by  the  chancellor  and  by  a  board  which  is  primarily  a  board  of  curators  of  the 
university  proper,  to  which  the  decisions  of  the  board  of  executives,  consisting  of  the 
heads  of  the  teachers  colleges  and  the  university  dean  of  education,  must  be  submitted  • 
for  approval. 

The  authors  of  this  bulletin  make  a  strong  plea  for  the  teaching  in  normal  schools 
of  courses  in  the  so-called  academic  subjects  for  both  elementary  and  high-school 
teachers — courses  which  shall  be  of  distinctly  collegiate  grade  in  quality  and  quantity. 
They  hold  that  in  such  subjects  as  arithmetic,  children's  literature,  algebra,  and 
geometry  it  is  possible  to  have  a  k'nd  of  course  which  will  not  be  simply  a  review  of 
previous  elementary  or  secondary  school  work,  nor  the  old  time  so-called  professional 
review,  nor  purely  academic  work  in  the  sense  that  this  term  is  used  in  connection  with 
courses  in  liberal  arts  colleges,  but  a  new  kind  of  course  consisting  of  advanced  work 
strictly  of  college  grade  with  a  professionalized  type  of  subject-matter.  The  purpose  of 
such  courses  would  be  to  lay  a  broad  foundation  of  scholarship  and  appreciation  for 
prospective  teachers,  giving  a  new,  a  larger,  and  a  different  kind  of  insight,  and  a 
broader  conception  of  subject-matter  than  the  students  previously  had  obtained. 

In  the  judgment  of  the  writer,  this  idea  of  a  new  ty^Q  of  subject-matter  courses  is 
one  of  the  highly  commendable  features  of  this  report.    For  example,  in  conn«ctJ'>»' 
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with  the  process  of  long  division  in  arithmetic,  the  survey  staff  believes  that  the  pro- 
spective teacher 

should  understand  the  mathematical  logic  of  the  process;  he  should  know  how  it 
evolved,  and  particularly  the  disadvantages  of  the  more  cumbrous  processes 
that  preceded  it.  He  thus  acquires  a  quite  new  view  of  something  with  which  he 
already  has,  in  his  own  judgment,  a  considerable  measure  of  familiarity.  His 
added  knowledge  may  not  include  materials  which,  as  a  teacher  of  elementary 
arithmetic,  he  will  pass  on  to  his  pupils,  but  it  will  deepen  his  appreciation  of  the 
importance  of  what  he  does  pass  on,  and  it  will  clarify  his  own  understanding  of 
the  process  itself. 

In  the  lower  grades, 

even  the  primary  teacher,  struggling  with  the  development  of  the  simplest 
number  concepts  and  processes,  will  find  new  insight  and  inspiration  for  her  work 
in  a  knowledge  of  primitive  number  systems  and  of  the  steps  that  the  race  tra- 
versed in  its  development  of  the  existing  system  of  notation  and  numeration.  If 
to  these  genetic  studies  one  adds  relevant  excursions  into  the  psychology  of 
number,  especially  in  connection  with  tests  and  scales,  it  is  clear  that  a  course  of 
distinctly  advanced  character  and  quality  is  obtained. 

The  principle  of  specific  preparation  for  specific  types  of  teaching  service  receives 
due  recognition  in  this  report.  Differentiated  curriculums  for  primary,  intermediate, 
grammar-grade,  rural,  and  high-school  teachers  are  recommended,  as  well  as  separate 
curriculums  for  teachers  and  supervisors  of  special  subjects.  This  recommendation 
will  receive  support  by  normal-school  teachers  and  administrators  and  by  public  school 
people  in  general,  for  it  represents  one  of  the  leading  tendencies  of  the  day  in  normal- 
school  organization. 

There  has  been  a  tendency  to  discredit  courses  in  psychology  in  normal  schools 
especially  in  the  first  year.  This  has  been  due,  not  to  the  fact  that  psychology  has  no 
place  in  the  preparation  of  teachers,  but  rather  to  the  fact  that  the  materials  included 
in  the  courses  in  psychology  have  been  very  poorly  chosen.  The  old-time  course  in 
general  psychology  dealt  very  largely  with  such  topics  as  consciousness,  association, 
perception,  conception,  judgment,  reasoning,  and  volition.  The  material  found  in  the 
traditional  formal  textbook  on  psychology  was  abstract,  philosophical,  metaphysical, 
and  speculative  to  such  a  degree  that  its  value  for  young  teachers  was  very  doubtful. 
This  kind  of  psychology  may  well  be  thrown  out  of  the  normal-school  curriculum,  but 
in  the  judgment  of  the  rev"ewer  there  is  a  type  of  material  dealing  with  the  mental 
processes  of  children  in  connection  with  the  learning  of  elementary  and  high-school 
subjects  which  has  great  value.  It  is  gratifying  to  find  that  the  survey  staff  supports 
the  view  that  the  proper  type  of  educational  psychology — as  well  as  other  similar 
basic  sciences — has  a  definite  place.    They 

conclude,  then,  that  the  study  of  psychology  in  the  teacher's  curriculum  has  to 
fulfil  two  fairly  distinct  functions:  (1)  it  must  provide  a  basis  for  explaining  and 
interpreting  successful  teaching  practices  as  well  as  principles  from  which  to 
derive  new  and  better  practices;  and  (2)  it  must  furnish  a  working  theory  of  the 
mental  life  as  a  basis  for  understanding  the  larger  problems  of  education,  many  of 
which  are  only  remotely  connected  with  teaching.  For  the  latter  purpose  psy- 
chology is  only  one  of  the  several  subjects  of  study,  each  of  which  should  contribute 
its  quota  of  principles,  hypotheses,  and  points  of  view  to  a  general  theory  of 
education.  A  substantial  groundwork  in  biology  is  doubtless  as  important  in 
this  regard  as  psychology,  while  the  claims  of  economics,  sociology,  and  the 
history  of  education  should  not  be  overlooked. 

The  suggestions  which  the  investigators  make  with  reference  to  the  organization 
of  courses  in  psychology  and  other  strictly  educational  subjects  are  thoroughly  good 
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and  constitute  perhaps  the  best  brief  statement  on  these  subjects  now  available.  It 
may  well  be  studied  carefully  by  teachers  of  education  in  normal  schools  and  colleges. 
In  the  mind  of  the  reviewer  the  discussion  of  practice  teaching  in  this  bulletin 
is  one  of  the  best  features  of  the  report.  They  find  that  in  Missouri  the  training  depart- 
ments tend  to  be  relatively  weak  as  compared  with  other  major  departments  in  the 
normal  schools.  The  survey  staff  deplores  the  fact  that  there  are  so  few  children  avail- 
able for  training  purposes  and  that  there  is  no  effective  connection  with  local  elemen- 
tary and  high  schools.  This  is,  however,  one  of  the  outstanding  difficulties  in  nearly 
all  normal  schools  throughout  the  country.  The  discussion  of  standards  of  practice 
facilities  and  the  suggestions  for  organizing  and  administering  practice  teaching  are 
thoroughly  excellent.  Many  bad  conditions  were  found  in  connection  with  training 
departments  in  Missouri,  such  as  inadequacy  of  courses  in  observation  and  practice, 
the  subordinate  position  of  the  training  school,  inferior  housing,  unsuitable  hygienic 
conditions,  unsatisfactory  correlation  of  work  of  normal  department  and  training 
department.  In  order  to  provide  a  solution  for  these  difiiculties  the  survey  staff  offers 
several  excellent  recommendations  which  normal-school  administrators  recognize  as 
fundamental : 

The  training  school  must  be  under  the  direct  control  and  supervision  of  an  expert 
administrator  fitted  by  experience  and  by  specialized  training  for  this  type  of 
work,  and  this  director  or  superintendent  must  have  under  his  immediate  charge 
a  corps  of  carefully  selected  and  specifically  trained  critics  or  supervisors.  The 
supervisory  staff  should  include  many,  if  not  most,  of  the  members  of  the  so- 
called  academic  departments,  and  the  entire  group  should  form  what  might  be 
termed  a  training-school  'cabinet.'  This  body  should  legislate  upon  all  matters 
concerning  the  organization  of  the  training  school  curriculum  and  questions  of 
educational  policy;  the  superintendent  or  director,  as  the  officer  in  whom  adminis- 
trative responsibility  is  lodged,  should  have  authority  to  make  decisions  upon  all 
matters  of  administration,  with  the  provision  that  any  other  member  of  the 
cabinet  may  appeal  from  his  decisions  to  a  higher  administrative  authority. 

A  plan  of  this  sort  would  ensure  (1)  the  administrative  autonomy  of  the  practice 
school  under  a  single  responsible  head,  and  (2)  the  responsible  cooperation  of  all 
academic  departments  and  all  members  of  the  critic  staff  in  the  organization 
of  the  school,  the  construction  of  the  curriculum,  and  the  oversight  of  the  student- 
teachers. 

It  is  advisable,  we  believe,  to  combine  the  headship  of  the  department  of  educa- 
tion and  the  directorship  of  the  training  department  in  one  and  the  same  person. 
The  other  members  of  the  staff  in  education  should  also  have  definite  responsibili- 
ties in  the  administration  and  supervision  of  the  training  school  to  the  end  that 
every  class  in  educational  theory  may  be  in  charge  of  a  teacher  who  is  in  daily 
touch  with  the  actual  problems  of  teaching  and  management  in  an  elementary 
or  a  secondary  school. 

The  tendency  on  the  part  of  normal  schools  to  develop  into  local  universities  is 
deplored.  The  specific  function  of  normal  schools  as  agencies  for  training  teachers  is 
clearly  and  excellently  set  forth;  and  the  tendency,  now  beginning  to  appear  through- 
out the  country  on  the  part  of  normal  schools  to  dissipate  their  energies  and  spend 
their  funds  in  maintaining  liberal  arts  colleges,  is  severely  criticized.  The  survey  staff 
sets  forth  its  criticism  here  in  vigorous  language,  maintaining  that 

it  is  diflScult  to  justify  the  proposal  of  any  school  ...  to  use  its  share  of  the 
all  too  scanty  training  funds  to  develop  a  local  university.  This  means  ...  to 
relegate  its  training  of  teachers  to  an  inconspicuous  department;  to  promote 
the  other  phases  of  collegiate  work  for  their  own  sake  and  not  alone  as  they 
produce  better  teachers;  to  fill  classes,  as  college  classes  are  now  filled,  with  some 


230  JOURNAL'EDU CATION AL  RESEARCH     Vol.  3,  No.  3 

who  will  teach,  some  who  will  farm,  some  who  will  be  politicians,  and  many  who 
have  no  specific  purpose;  in  other  words,  to  sacrifice  the  enormous  advantage  of 
momentum  and  morale  that  inheres  in  a  single  fine  idea  well  worked  out,  for  a 
round  of  inevitable  mediocrity.  For  the  school  has  at  best  wholly  insufficient 
funds  for  its  present  logical  purpose — the  preparation  of  a  competent  teacher  for 
every  position  in  its  district.  To  take  over  othei  subjects,  as  these  are  conceived 
in  modem  education,  is  not  only  to  fail  in  its  proper  task,  but  to  fail  altogether. 

They  claim  further  that 

a  good  normal  school  is  a  professional  school  throughout  and  can  not  be  an  arts 
coUege;  if  it  wishes  to  conduct  a  college  that  is  self-respecting,  it  must  have 
double  funds,  separate  classes,  another  faculty  selected  for  that  purpose,  and 
so  on.  The  combination  is  not  a  happy  one  in  any  place  where  it  is  now  on  trial, 
and  the  logic  both  of  theory  and  experience  is  against  it. 

Everywhere  throughout  this  volume  higher  standards  of  teaching  and  better 
work  both  in  quantity  and  quality  are  strongly  urged.  Especially  insistent  is  the 
recommendation  that  normal  schools,  or  teachers  colleges  as  they  are  now  coming 
somewhat  generally  to  be  called,  must  be  on  the  same  plane  of  scholarship  as  the  best 
universities  and  colleges.  The  fact  is  acknowledged  that  very  many  normal  schools 
are  already  in  this  class,  and  it  is  gratifying  to  find  this  admission  set  forth  in  emphatic 
terms  in  connection  with  the  equally  emphatic  demand  that  standards  of  normal- 
school  instruction  everywhere  be  raised  to  the  highest  collegiate  level.  The  following 
statement  will  be  accepted  as  thoroughly  justifiable: 

Longer  to  maintain  the  distinction  between  the  university  and  the  normal 
school  as  representing  a  distinguishable  difference  in  grade  or  quality  of  instruc- 
tion is,  in  the  cases  of  the  best  normal  schools  in  this  country,  purely  factitious; 
and  its  eradication  would  be  the  best  possible  reason  for  requiring  of  inferior 
schools  a  genuine  enforcement  of  the  standards  to  which  most  of  them  now  profess 
their  adherence.  In  the  numerous  American  normal  schools  now  doing  thoroughly 
standard  work,  the  instructors  have  as  broad  and  as  intensive  training  as  those 
giving  instruction  to  students  of  equal  advancement  in  good  colleges  and  universi- 
ties, and  are  quite  frequently  superior  in  this  respect.  In  the  content  of  instruc- 
tion the  normal  school  provides  a  specialized  professional  organization  of  material 
that  in  its  field  is  as  significant  technically  as  any  work  in  medicine  or  law.  The 
teaching  in  first  class  normal  schools  is  probably  in  advance  of  that  to  be  found 
in  ordinary  arts  colleges  or  even  in  the  better  medical  and  law  schools. 

Finally,  it  may  be  said  in  general  that  this  document  is  a  most  inspiring  piece  of 
educational  Hterature  to  anyone  who  is  vitally  interested  in  a  better  preparation  for 
teachers.  No  other  discussion  of  this  topic  contains  so  many  suggestions  for  improving 
methods  of  teacher  preparation  or  so  fearlessly  criticizes  that  which  the  authors  beheve 
to  be  wrong  in  conception,  or  faulty  in  execution.  The  criticisms  are  as  inspiring  as  the 
vision  of  better  preparation  of  teachers.  The  authors,  as  well  as  the  Carnegie  Founda- 
tion for  the  Advancement  of  Teaching,  have  rendered  a  great  service  in  producing  this 
volimie. 

H.  A.  Beown 
Slate  Normal  School, 

Oshkosh,  Wisconsin. 

CouRSAtJLT,  Jesse  H.    The  principles  of  education.    New  York:  Silver  Burdett  and 
Company,  1920.    468  pp. 

The  author  aims  "to  present  with  logical  cogency  a  simple  and  definite  system  of 
principles  for  guiding  educational  thought  and  practice."    He  has  taken  his  task 
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seriously.  He  has  read  widely  and  with  painstaking  care  a  large  amount  jf  literature, 
has  been  associated  with  some  of  the  leading  educational  theorists  in  America,  and  has 
had  twelve  years  of  classroom  experience  as  teacher  of  the  subject,  supplemented  by 
other  work  in  the  training  of  teachers.  The  culled  fruit  of  this  reading,  association, 
and  experience  is  gathered  together  in  this  volume. 

The  general  point  of  view  of  the  book  places  its  author  with  those  who  (a)  regard 
true  education  as  a  process  of  growth,  and  (b)  propose  to  put  education  on  a  scientific 
basis.  And  while  both  ideas  are  rather  narrowly  conceived,  so  that  many  who  would 
agree  with  the  author  as  to  the  desirability  of  the  proposed  ends  would  find  themselves 
in  fundamental  disagreement  with  him  at  important  points,  no  one  could  study  the 
book  without  arriving  at  deeper  insight  into  the  relation  of  educational  theory  to 
social  life.    The  book  represents  a  big  view  and  sustained  cogitation. 

Professor  Coursault's  "Principles"  is  a  most  diflScult  book  to  estimate  fairly,  for 
this  reason:  it  presents  a  living  theory  of  education  in  the  most  deadly  manner  imagin- 
able. A  sermon  by  Jonathan  Edwards  is  wildly  exciting  in  comparison.  The  doctrine 
for  which  the  author  stands  is  expressive  of  the  pioneer  spirit  in  the  contemporary 
educational  world,  but  the  whole  cast  of  the  book  is  medieval.  The  present  reviewer 
agrees  with  the  four  teachers  to  whom  he  handed  the  book  for  a  criticism  of  the  chapters 
on  their  several  fields  of  instruction.  Without  exception  thev  spoke  of  having  found 
interesting  and  enlightening  suggestions  in  the  chapters  dealing  with  their  subjects, 
and  without  exception  they  expressed  their  utmost  sympathy  for  any  students  whose 
instructor  should  be  misguided  and  inhuman  enough  to  choose  Professor  Coursault's 
"Principles"  as  their  textbook.  This  criticism  does  not  mean  to  imply  that  college 
texts  should  be  popular  reading  but  simply  that  they  should  be  a  good  deal  more  than 
lecture  notes  run  through  a  printing  press. 

M.  C.  Otto 
University  of  Wisconsin 

Hubert,  William  Nutt.  The  supervision  of  instruction.    Boston:  Houghton  Mifflin 
Company,  1920.  270  pp. 

The  purpose  of  this  hook  is  not  only  to  state  and  analyze  the  principles  of  super- 
vision but  also  to  give  concrete  devices  and  a  technic  for  the  administration  of 
the  principles. 

The  book  is  well  organized  and  written  in  a  very  readable  style.  In  the  introduc- 
tion the  author  states  that  there  are  two  fundamental  and  distinct  questions  in  the 
problem  of  training  supervisors.  (1)  "What  are  the  activities  that  supervisors  in 
training  schools  and  in  public  schools  carry  on  in  the  performance  of  their  duties?" 
(2)  "What  are  the  kinds  of  training  that  best  prepare  supervisors  to  perform  these 
duties?" 

In  the  first  part  of  the  book  the  author  defines  the  work  of  the  supervisor  and  ana- 
lyzes it  into  eight  distinct  phases  as  follows: 

1.  He  must  lay  the  basis  for  effective  cooperative  teaching. 

2.  Select  and  organize  the  subject  matter  of  courses  of  study. 

3.  Teach  for  purposes  of  demonstration  and  experimentation. 

4.  Direct  systematic  observation. 

5.  Direct  the  teaching  activities  of  his  teachers. 

6.  Check  up  progress  made  by  pupils. 

7.  Measure  the  efficiency  and  progress  of  his  teachers. 

8.  Measure  the  efficiency  of  his  own  supervising  performances. 


232  JOURNAL  EDUCATIONAL  RESEARCH      Vol.  3,  No.  3 

The  second  part  of  the  book  is  devoted  to  a  description  of  methods,  devices,  and 
technic  for  accomplishing  the  eight  duties  of  the  supervisor.  UnUke  most  writers  on 
supervision  the  author  does  not  stop  with  general  statements  but  gives  details  of 
method  and  numerous  illustrations  of  devices  and  technic. 

At  the  end  of  each  chapter  there  is  a  brief  summary  and  also  a  list  of  class  exer- 
cises. Because  of  the  wealth  of  concrete  illustrations  and  suggestions  the  book  is  well 
adopted  for  classes  in  training  schools.  Superintendents  and  supervisory  officers 
will  also  find  it  helpful  and  suggestive. 

P.  R.  Stevenson 
University  of  Illinois 

HuDELSON,  Earl.    Hudelson  English  composition  scale.    Yonkers-on-Hudson :  World 

Book  Company,  1921.    46  pp. 

The  Hudelson  English  Composition  Scale  differs  from  other  available  composition 
scales.  It  is  printed  in  monograph  form  instead  of  on  a  single  sheet.  An  entire  page 
is  given  to  each  step  of  the  scale.  In  addition  to  the  scale  itself  the  monograph  contains 
the  following  sections:  (1)  purposes  and  use;  (2)  how  to  use  the  Hudelson  Scale; 
(3)  samples  for  practice  in  scoring. 

The  scale  consists  of  sixteen  compositions  spaced  at  intervals  of  approximately 
0.5  P.  E.  The  values  of  the  compositions  were  determined  by  the  average  rating 
given  to  them  on  the  Nassau  County  Supplement  to  the  Hillegas  Scale  by  96  teachers 
of  composition  who  had  been  given  two  weeks  intensive  training  in  the  scoring  of 
compositions  by  this  scale.  Eleven  of  the  16  compositions  were  written  by  school 
children  in  the  state  educational  survey  of  Virginia.  Four  compositions  were  taken 
from  Thomdike's  collection  of  150  compositions  arranged  for  use  in  psychological  and 
educational  experiments.  One  composition  was  chosen  from  the  Thorndike  Extension 
of  the  Hillegas  Scale.  The  compositions  written  by  the  Virginia  school  children  were 
on  the  topic  "The  most  exciting  ride  I  ever  had."  The  scale  is  recommended  for 
use  with  this  topic.  The  grade  standards  for  the  scale  were  derived  from  those 
obtained  from  the  Nassau  County  Supplement  to  the  Hillegas  Scale.  The  themes 
used  as  the  basis  of  these  standards  were  written  on  the  topic  "What  I  should  like  to 
do  next  Saturday."  Mr.  Hudelson  states  that  he  has  found  that  when  the  same 
children  write  compositions  on  the  two  topics  "The  most  exciting  ride  I  ever  had," 
and  "What  I  should  like  to  do  next  Saturday,"  the  median  scores  of  the  themes, 
on  the  first  topic  are  0 .  78  of  a  step  higher  than  when  both  are  rated  on  the  Nassau 
County  Supplement.  Thus  in  making  the  comparison  with  the  norms  it  is  necessary 
to  subtract  0.78  from  the  scores.  Thirty  compositions  whose  values  have  been 
determined  on  the  scale  are  given  for  practice  and  by  means  of  this  list  a  person 
may  train  himself  to  rate  themes  with  a  high  degree  of  reliability. 

From  a  practical  point  of  view  the  fact  that  the  scale  is  not  printed  on  a  single 
sheet  of  paper  so  that  one  may  have  all  of  it  before  him  at  one  time  seems  to  con- 
stitute a  distinct  handicap.  It  is  possible  that  this  handicap  may  be  no  more  than 
one  of  inconvenience  but  it  seems  not  at  all  unlikely  that  it  might  materially  influence 
the  ratings  given  to  the  compositions.  The  steps  of  the  scale  are  about  half  that  of 
the  Nassau  County  Supplement  and  the  Willing  Composition  Scale.  This  makes  a 
more  finely  divided  instrument.  Unless  the  use  of  the  scale  shows  that  it  is  impossible 
for  one  person  to  rate  compositions  more  accurately  than  one  P.  E.  this  feature  of  the 
scale  should  increase  its  usefulness. 

W.  S.  M. 


N^tuH  Sterna  unh  (HnmnmnitntxanB 

This  department  will  contain  news  items  regarding  research  workers 
and  their  activities.  It  will  also  serve  as  a  clearing  house  for  more  formal 
communications  on  similar  topics,  preferably  of  not  more  than  five  hundred 
words.  These  commimications  will  be  printed  over  the  signatures  of  the 
authors.  Address  all  correspondence  concerning  this  department  to  Walter 
S.  Monroe,  University  of  Illinois,  Urbana,  Illinois. 


The  first  number  of  the  newly  organized  Journal  of  lite  National  Education 
Association  appeared  under  date  of  Januarj',  1921.    This  journal,  which  is  edited  by 

W.  C.  Bagley,  supersedes  the  Bulletin.  An  Editorial  Council  is  pro- 
Journal  of  vided  for  which  is  to  be  primarily  a  legislative  body  charged  with  the 
the  N.E.A.      responsibilities  of  determining  editorial  policies  of   the  publication. 

The  first  number  is  largely  devoted  to  editorial  announcements  and 
propaganda  relative  to  education  legislation.  The  journal  is  distributed  to  all  active 
members  of  the  N.  E.  A.  The  announcement  is  made  that  the  membership  this  year 
will  exceed  100,000.  A  journal  which  reaches  a  large  number  of  educators  has  an 
unusual  opportunity  as  well  as  responsibility.  It  is  to  be  hoped  that  appropriate 
recognition  will  be  given  to  the  field  of  research. 

At  the  University  of  Wisconsin  in  connection  with  the  training  of  teachers  of 
Latin,  a  so-called  Latin  laboratory  is  in  operation.     Its  purpose  is  to  collect  and 

organize  as  much  material  as  possible  which  will  be  of  use  to  teachers 
A  Latin  of  secondary  Latin.    Lists,  for  example,  of  Latin  plays  and  stories  are 

Laboratory     available.     A  periodical  leaflet,  Latin   Notes,  is  issued.     Material  for 

supplementary  teaching  in  Latin  is  devised,  collected,  and  distributed — 
material  which  gives  meaning,  not  to  say  punch,  to  the  teaching  of  Latin.  The  labora- 
tory is  under  the  direction  of  Professor  Frances  E.  Sabin.  The  organization  of  this 
sort  of  a  bureau  or  laboratory  with  reference  to  other  subjects  of  the  curriculum  would 
add  materially  to  the  service  work  of  state  universities  and  state  departments. 

Dr.  Lester  M.  Wilson,  Professor  of  Psychology  in  the  Eastern  Illinois  State  Nor- 
mal School,  Charleston,  sailed  January  twenty-sixth  for  Lima,  Peru,  where  he  has 
the  position  of  Director  of  Studies  and  Examinations  for  the 
American  Educa-      Republic  of  Peru,  at  an  annual  salary  of  $7,200.    Dr.  Wilson  will 
tors  in  Foreign  have  charge  of  the  certification  of  teachers,  the  making  of  curricu- 

Countries  lums  for  elementary  and  secondary  schools,  and  the  standardizing 

of  schools  in  the  new  five-year  program  that  Peru  is  now  putting 
into  operation  for  the  improvement  of  its  school  system.  Dr.  Wilson  is  one  of  thirty 
educators  whose  services  have  been  secured  by  the  Peruvian  government.  Dr.  H.  G. 
Lull,  State  Normal  School,  Emporia,  Kansas,  is  to  become  head  of  the  teacher  training 
work. 

Professor  E.  E.  Jones,  head  of  the  Department  of  Education,  Northwestern 
University,  will  sail  late  in  May  for  Albania  to  assist  in  the  reconstruction  of  their 
educational  system.  In  addition  to  Professor  Jones  the  Albanian  government  expects 
to  secure  the  services  of  at  least  one  other  American  educator  who  will  assist  them  in 
their  educational  activities. 
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This  step  on  the  part  of  the  governments  of  Peru  and  Albania  confers  an  unusual 
compliment  upon  American  education.  It  is  not  many  years  since  America  was  draw- 
ing heavily  upon  certain  European  sources  for  its  educational  inspiration.  It  is  very 
gratifying  to  find  that  we  have  now  progressed  to  the  point  where  other  nations  are 
looking  to  us  for  guidance  in  educational  matters. 

Information  coming  from  Ohio  during  the  past  few  months  has  indicated  a  keen 
interest  in  educational  research  on  the  part  of  school  men  of  the  state.  A  great  deal 
of  this  has  centered  about  the  activities  of  Professor  R.  L.  Morton, 
Ohio  Educa-  Ohio  University,  Athens,  Ohio.  Professor  Morton  tells  in  a  recent 
tional  Research  letter  of  the  organization  of  the  Ohio  Educational  Research  Associa- 
Association  tion.    He  points  out  the  attempt  to  safeguard  the  organization  so  as 

to  "insure  a  membership  of  active  constructive  workers."  The 
methods  employed  are  indicated  in  the  following  paragraphs  which  are  quoted  from 
his  letter: 

Applications  for  membership  must  first  be  approved  by  the  executive  commit- 
tee and  then  accepted  by  a  majority  vote  of  those  present  at  a  regular  meeting. 
The  executive  committee  plans  a  thorough  inquiry  into  the  training  and  experience 
of  each  applicant  particularly  the  appHcant's  training  and  experience  in  studying 
educational  problems  scientifically.  Furthermore,  at  no  time  shall  the  total 
membership  of  the  organization  be  permitted  to  exceed  100  persons.  A  scramble 
for  the  37  empty  berths  has  already  begun  and  it  is  anticipated  that  there  wiU  soon 
be  a  waiting  Ust. 

One  section  of  the  article  on  membership  reads  as  follows:  *  Annually,  on 
January  first,  the  secretary-treasurer  shall  revise  the  membership  list  eliminating 
therefrom  (a)  those  who  have  failed  to  maintain  membership  in  the  Ohio  State 
Teachers  Association;  (b)  those  who  have  failed  to  pay  their  dues  in  this  Depart- 
ment for  the  year  just  ended;  and  (c)  those  who  have  failed,  in  the  judgment  of 
the  executive  committee,  to  submit  to  the  secretary-treasurer  in  the  two-year 
period  just  ended,  evidence  of  constructive  activity  in  the  field  of  educational 
research," 

In  view  of  the  fact  that  a  number  of  similar  organizations  in  other  sections  of  the 
country  have  failed  to  maintain  constructive  activity,  this  attempt  of  the  Ohio  Educa- 
tional Research  Association  will  be  watched  with  interest  by  many  persons.  If  the 
association  survives  the  decline  of  interest  and  enthusiasm  which  will  inevitably  come 
after  the  newness  of  the  project  wears  ofif,  it  will  have  demonstrated  the  value  of  the 
plan  of  organizations. 

The  oflScers  of  the  Association  follow : 

President:  R.  L.  Morton,  Director  and  Professor  of  Education,  Extension  Depart- 
ment, Ohio  University,  Athens. 
Vice-President:  A.  R.  Mead,  Professor  of  Education,  Ohio  Wesleyan  University, 

Delaware. 
Secretary-Treasurer:  F.  J.  Prout,  Superintendent  of  Schools,  Chillicothe,  Ohio. 
The  Executive  Committee  consists  of  the  president,  the  secretary-treasurer,  and 

three  other  members,  as  follows : 
Garry  C.  Myers,  Head  of  Department  of  Psychology,  Cleveland  School  of  Educa- 
tion, Cleveland. 
John  R.  Patterson,  Superintendent  of  Schools,  Buc3T1is. 


Can  Students  Estimate  Their  Own  Intelligence? 

In  our  classes  in  mental  tests  the  question  is  frequently  asked  by  the  students 
whether  it  is  very  wholesome  for  children  and  students  to  be  told  the  results  of  the 
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tests,  or  in  any  way  to  be  made  aware  of  their  relative  standing  in  intelligence.  To 
this  question  the  reply  is  invariably  made  that  students  and  children  usually  know 
their  relative  standing  in  mentality  anyway.  Recently  a  situation  has  been  created  in 
our  school  which  may  throw  some  light  on  the  extent  to  which  this  reply  has  any  basis 
in  fact. 

At  the  opening  of  our  first  quarter  this  year,  our  school  decided  to  permit  such 
students  as  succeeded  in  making  a  score  in  the  Army  Alpha  Test  which  was  equivalent 
to  that  of  the  upper  fourth  of  our  college  distribution  to  carry  one  hour  in  addition 
to  the  sixteen  hours  which  are  normally  allowed,  and  to  permit  those  who  made  a  score 
equivalent  to  the  upper  eighth  of  the  distribution  to  carry  two  hours  extra.  Under 
such  conditions  it  is  reasonable  to  suppose  that  those  students  who  feel  that  they  are 
unable  to  pass  the  test  will  not  make  the  attempt.  However,  the  situation  is  not  free 
from  disturbing  factors.  Most  of  the  students  did  not  know  just  what  their  relative 
standing  among  their  classmates  had  to  be  in  order  to  pass  the  test.  Others  were 
impelled  to  make  an  attempt  in  order  that  they  might,  if  successful,  be  permitted  to 
take  the  program  which  they  had  planned.  It  is  not  always  an  easy  matter  for  students 
to  make  out  a  program  of  just  sixteen  hours  which  contains  the  courses  they  most 
desire  to  take.  Still  other  students  who  were  bright  did  not  desire  to  carry  extra  hours 
and  therefore  did  not  come  up  for  the  test.  In  spite  of  these  disturbing  factors,  I  think 
our  results  are  of  some  value. 

Several  years  ago  265  of  our  students  took  the  Army  Alpha  Test.  Of  these 
students  85  percent  were  in  their  first  and  second  college  years  and  the  remainder  in 
their  third,  fourth,  and  fifth  years.  From  the  results  of  these  tests  we  obtained  the 
upper  quartile  and  the  upper  octile  which  are  now  used  as  standards  for  determining 
whether  a  student  shall  be  permitted  to  carry  only  the  normal  16  hours  or  one  or  two 
hours  additional.  The  upper  quartile  is  141  and  the  upper  octile  154.  For  the  same 
results  the  median  and  the  lower  quartile  are  122  and  104  respectively. 

At  the  opening  of  the  fall  and  winter  quarters  of  the  present  year,  a  total  of  46 
students  took  the  extra  hour  examination.  For  this  group  the  first,  second,  and  third 
quartiles  are  130.6,  147.5,  and  162.5  respectively.  The  median  for  this  group, 
therefore,  is  three  points  higher  than  our  standard  quartile  and  the  upper  quartile  for 
the  group  is  eight  points  higher  than  our  standard  octile.  To  express  the  result  in 
other  terms,  41  percent  of  the  extra  hour  group  equaled  or  exceeded  the  upper  octile 
and  61  percent  equaled  or  exceeded  the  upper  quartile  of  our  standard  distribution. 
The  remaining  39  percent  fell  below  the  upper  quartile  but  only  17  percent  fell  below 
the  median  of  the  standard  distribution.  If  it  be  assumed  that  students  who  exceed 
the  median  of  their  group  know  that  they  are  bright;  and  if  the  element  of  chance  and 
the  size  of  our  group  be  left  out  of  account,  it  may  be  said  that  83  percent  of  our 
students  knew  that  they  were  bright,  or  ranked  above  the  average  intelligence  of  our 
student  body.  This  is  true  in  spite  of  the  fact  that  many  of  the  students  took  the 
examination  under  the  pressure  of  their  desire  to  carry  a  program  which  appealed  to 
them.    If  the  factor  of  chance  be  allowed,  62  percent  knew  that  they  were  bright. 

It  should  be  pointed  out  in  this  connection  that  of  the  extra  hour  group  25  percent 
were  in  the  third,  fourth,  and  fifth  years.  This  is  10  percent  more  than  were  in  the 
group  upon  which  our  standards  are  based.  The  students  of  our  upper  classes  tiest 
distinctly  higher  than  those  of  our  lower  classes.  The  median  score  of  a  group  of  57 
third,  fourth  and  fifth  year  students  is  approximately  144.    The  higher  percent  of 
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upper  class  students  is  somewhat  offset  by  the  fact  that  5  percent  of  the  group  belonged 
to  our  high-school  group. 

J.  D.  Heilman 

Colorado  State  Teachers  College,  Greeley,  Colorado 

Scale  for  Measuring  Ability  in  Silent  Reading,  Picture  Supplement  Scale  1, 

or  PS-1 

The  new  scale  for  the  measurement  of  ability  in  silent  reading,  Picture  Supplement 
Scale  1,  consists  of  a  single  sheet  of  paper,  12  inches  wide  and  19  inches  long.  The  sheet 
is  divided  into  five  columns.  Each  column  is  divided  into  four  sections,  and  in  each  of 
these  sections  there  are  a  picture  and  a  paragraph  about  the  picture.  The  paragraph 
tells  the  child  to  make  a  mark  or  line  with  his  pencil  to  supplement  the  meaning  of 
the  picture. 

The  instructions  are  extended  through  the  paragraphs  in  such  a  way  that  they 
cannot  be  fully  grasped  unless  the  entire  paragraph  is  read.  They  are  so  worded  that 
they  cannot  be  misunderstood  in  moderately  careful  reading;  and  can  be  correctly 
followed  in  only  one  way.  There  are  no  tricks  or  puzzles.  The  child  who  guesses  is 
almost  sure  to  make  a  mistake;  but  if  he  reads  carefully  his  answering  markings  will 
be  "right";  that  is,  they  will  be  in  accord  with  the  instructions  given  him.  The  para- 
graphs are  all  of  equal  difficulty;  and  the  child's  score  is  the  number  of  paragraphs 
which  he  can  read  and  mark  correctly  in  five  minutes. 

The  new  scale  is  designed  to  measure  silent  reading  ability  in  grades  three  to  eight 
inclusive  by  strictly  utilitarian  standards.  The  attempt  has  been  to  devise  a  test 
in  which  the  child  can  readily  succeed  if  he  reads  well  enough  to  grasp  the  important 
thought  in  each  section,  and  in  which  he  cannot  succeed  at  all  unless  he  does  compre- 
hend each  important  thought.  The  scale  measures  the  ability  to  read  carefully;  it 
measures,  that  is,  the  ability  which  is  commonly  necessary  for  the  effective  use  of  text 
and  reference  books. 

Picture  Supplement  Scale  1  has  four  outstanding  characteristics.  The  first  is 
that  it  makes  a  definite  attempt  to  measure  a  single  ability,  which  is  the  ability  to  read 
silently  a  single  t>'pe  of  material,  at  a  constant  level  of  difficulty,  in  a  fixed  period  of 
time.  It  measures  the  amount  of  reading  of  a  practically  useful  nature  which  the  child 
can  do  in  five  minutes. 

The  second  outstanding  feature  of  the  new  scale  is  that,  in  its  construction, 
extraneous,  non-reading  factors  have  been  eliminated.  A  careful  attempt  has  been 
made  to  discover  the  controlling  factors  which  govern  the  child's  performance  in  silent 
reading.  Some  25  such  elements  have  been  identified.  One,  the  child's  rate  of  reading, 
has  been  adopted  as  the  variable  to  be  measured;  and  the  remaining  24  factors  have 
been,  in  so  far  as  possible,  held  constant.  It  is  believed  that  by  following  this  method 
a  test  has  been  prepared  in  which  every  task  presents  the  same  type  of  reading  diffi- 
culty as  every  other,  and  for  which  the  scores  represent  comparative  amounts  of  one 
single  sort  of  reading  ability. 

The  third  outstanding  feature  is  that  the  test  is  planned  for  classroom  use.  It  can 
be  given  to  large  numbers  of  pupils  simultaneously.  It  requires  five  minutes  for  actual 
testing;  and  can  be  scored  accurately,  rapidly,  and  easily,  without  the  use  of  a  key. 
The  cost  of  printing  has  been  kept  extremely  low. 

The  fourth  outstanding  feature  is  that,  on  the  basis  of  results  secured  through 
extensive  classroom  experiments,  grade  scores  have  been  turned  into  equivalent  scale 
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values.  This  makes  it  possible,  in  testing  with  Picture  Supplement  Scale  1,  to  measure 
the  ability  of  each  child  in  terms  of  its  relation  to  the  known  abilities  of  other  children, 
who  are  approximately  of  the  same  degree  of  maturity,  and  have  received  approxi- 
mately the  same  amounts  of  training. 

Picture  Supplement  Scale  1  has  been  developed  through  a  long  series  of  experi- 
ments, in  the  course  of  which  five  other  scales  for  measuring  silent  reading  were 
devised,  tried  out,  and  laid  aside.  The  monograph  on  "The  Measurement  of  Silent 
Reading"  which  is  now  in  press,  describes  these  experiments  in  detail,  and  devotes 
several  chapters  to  the  discussion  of  the  fundamental  principles  of  measurement  which 
were  identified  as  basal  to  the  work  in  silent  reading.  Special  attention  is  given  to  the 
reasons  which  led  to  the  adoption  of  the  "scale  for  amount  done,"  with  quality  and 
difficulty  held  constant,  as  differentiated  from  "scales  for  quality  of  product,"  or 
"scales  for  difficulty  reached." 

Since  for  practical  work  in  the  classroom  it  is  clearly  desirable  to  make  available 
several  alternate  editions  of  a  scale,  so  that  children  tested  on  one  may  later  be  again 
tested  with  new  material  of  equal  difficulty,  and  their  progress  noted;  companion  edi- 
tions to  Picture  Supplement  Scale  1  have  been  prepared,  and  will  shortly  be  available. 
Picture  Supplement  Scales  2,  3,  and  4  are  of  the  same  type  and  the  same  difficulty  as 
Picture  Supplement  Scale  1.  The  four  scales  may  be  used  interchangeably;  and  scores 
secured  in  one  may  be  compared  directly  with  scores  secured  in  the  other  three. 

May  Ayres  Burgess 
Russell  Sage  Foundation, 

130  East  Twenty-second  Street, 
New  York  City 

Meeting  of  the  American  Psychological  Association 

The  recent  meetings  of  the  American  Psychological  Association,  held  at  Chicago 
during  the  Christmas  holidays,  included  a  total  of  57  papers,  three  addresses,  and  a 
symposium.  Under  the  circumstances,  the  writer  acquiesced  to  the  request  that  he 
report  the  meetings,  for  the  Journal  of  Educational  Research,  only  after  some 
hesitation.  However,  many  of  the  papers  dealt  with  subjects  hardly  of  interest  to 
readers  of  the  Journal.  In  other  instances  there  was  a  certain  amount  of  dupli- 
cation.    So — the  reader  need  not  dread  a  catalog  of  the  entire  57. 

A  preliminary  classification  of  the  entire  series  is,  however,  of  some  interest,  in 
fact,  of  some  importance  as  indicative  of  present  trends  in  research.  Thirteen  papers, 
according  to  the  writer's  count,  dealt  with  some  phase  of  learning — the  largest  single 
group  of  papers.  Twelve  dealt  with  measures  of  ability  or  related  matters.  Five 
dealt  with  measures  of  emotional  or  other  non-intellectual  traits.  Seven  papers  were 
of  a  theoretical  nature,  eight  of  the  older  type  of  experimental  work;  eight  dealt  with 
abnormal  psychology,  nine  with  animal  psychology,  eight  had  to  do  with  psychology 
in  business.  Twenty  related  more  or  less  explicitly,  in  one  way  or  another,  to  educa- 
tional investigation. 

f  Comparison  with  previous  programs  brings  out  certain  features  of  distinct  inter- 
est.' Measures  of  emotional  traits  appear  largely  for  the  first  time  on  such  a  program. 
The  writer  cannot  but  feel  that  the  appearance  of  work  along  these  lines  is  of  very 
great  significance.    And  the  work  comes  largely  from  hard-headed  investigators  of 

I  It  would  be  an  interesting  study  to  compare  programs  over  a  period  of  years,  and  so  follow  fads  and 
fashions  in  psychological  research  1  The  programs  of  even  four  years  ago  look  antiquated  now. 


238  JOURNAL  EDUCATIONAL  RESEARCH     Vol  3,  No.  3 

personnel  problems  in  big  business.  That  these  workers  should  find  measures  of 
general  intelligence  decidedly  inadequate,  in  selecting  good  salesmen  or  executives, 
surely  suggests  the  possibility  that  the  present  great  emphasis  upon  the  intellectual 
endowment  of  the  child,  as  the  all-important  factor  in  the  educational  situation,  may 
be  one-sided  and  inadequate.  And  the  vigorous  efforts  at  measurement  of  these 
extra-inteUectual  traits  in  personnel  work  should  stimulate  analogous  effort  to  measure 
temperament  and  character  in  school  children.  The  writer  ventures  the  prediction 
that  five  years  from  now  tests  of  interest,  emotion,  moral  trends,  will  be  quite  as 
informing  as  measure  of  intelligence.    But  now  for  the  papers  themselves. 

It  has  been  said  that  the  importance  of  a  paper  might  be  measured  by  the  amount 
of  discussion  it  arouses.  So  evaluated.  Professor  Thurstone's  was  the  all-important 
paper  of  the  first  session,  in  spite  of  the  fact  that  it  treated  that  threadbare  topic 
"What  Should  be  Taught  in  the  Elementary  Course?"  (in  psychology).  For  the 
average  teacher  who  has  dragged  through  the  weary  series  of  pedantries  and  banalities 
which  make  up  the  usual  elementary  course  in  psychology,  Professor  Thurstone's 
ideas  should  refresh  and  delight.  He  dares  to  imply  that  knowledge  of  the  cold  spots 
and  the  end-organ  of  Krause,  theories  of  visual  contrast,  or  introspection  regarding  the 
thought  process,  may  not  be  so  fundamental  for  an  introduction  to  psychology  as 
current  practice  might  suggest.  And  he  would  prefer  that  the  elementary  course 
should  treat  more  of  characterology — would  like  some  little  reference  to  Freud,  and 
discussion  of  mental  hygiene.  Surely  it  is  such  study  of  character  traits,  life  motives, 
emotional  trends,  conflicts  and  compensations,  that  needs  more  consideration  in 
educational  psychology. 

Other  papers  appearing  in  the  session  for  general  psychology  dealt  for  the  most 
part  with  topics  hardly  of  interest  to  a  school  man.  Similarly  technical  and  hardly  of 
interest  to  readers  of  the  Journal  were  most  of  the  papers  dealing  with  learning.  Six 
papers  were  concerned  wholly  or  in  part  with  the  learning  of  mazes;  such  work  is  of 
great  interest  and  importance  in  analyzing  the  fundamental  factors  involved  in  the 
learning  process,  but  can  hardly  be  reported  here.  A  "Report  on  a  Series  of  New 
Learning  Tests"  by  Augusta  F.  Bronner  of  the  Judge  Baker  Foundation,  Boston, 
deserves  mention,  however,  also  do  papers  by  Robinson  (University  of  Chicago)  on 
"Distribution  of  Effort  in  Memorizing  and  Its  Effect  upon  Retention,"  and  Edwards 
(University  of  Georgia)  on  "Methods  of  Study." 

The  papers  dealing  with  problems  in  clinical  psychology  were  not,  perhaps,  so 
numerous  as  might  have  been  expected,  in  view  of  the  great  activity,  at  present,  along 
these  lines.  G.  W.  A.  Luckey  (Lincoln,  Nebraska)  discussed  "The  Services  of  the 
Clinical  Psychologist."  He  emphasized  the  importance  of  such  adjustments  as  the 
clinical  psychologist  aims  to  bring  about,  and  stressed  the  need  for  clinical  study  in  the 
elementary  schools  aftd  in  juvenile  courts.  No  child,  he  asserted,  should  pass  through 
the  elementary  schools  without  receiving  a  mental  and  physical  examination  by  the 
best  of  experts.  Dr.  Goddard,  of  the  Ohio  Bureau  of  Juvenile  Research,  emphasized 
the  importance  of  qualitative  as  well  as  quantitative  differences  in  ability.  It  is  not 
sufficient  merely  to  obtain  an  I.  Q.  or  mental  age  on  the  Binet  scale;  an  individual  may 
be  psychopathic  or  abnormal  with  an  I.  Q.  of  100  or  140  as  well  as  with  an  I.  Q.  of  75  or 
50.  Dr.  Mateer,  also  of  the  Bureau,  discussed  "The  Clinical  Significance  of  the  Kent- 
Rosanoff  Association  Tests."  Such  investigation  of  free  association  has  been  found 
valuable  by  the  Bureau,  in  intensive  study  of  atj^ical  cases. 

Wallin,  of  the  Psycho-educational  Clinic  at  St.  Louis,  presented  a  "Comparison 
of  Three  Methods  for  Making  Initial  Selection  of  Presumptive  Mental  Defectives," 
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in  the  public  schools.  The  three  methods  were  (1)  initiation  of  examinations  left 
entirely  with  the  individual  schools;  (2)  selection,  by  the  Psycho-educational  Clinic 
from  preliminary  reports  made  by  the  elementary  schools  (the  reports  being  compul- 
sory for  all  schools)  twice  annually  on  a  prepared  form,  of  children  judged  to  be  most 
deficient  mentally;  and  (3)  selection  of  pupils  making  the  lowest  scores  in  a  group  intel- 
ligence test  (Pressey  Primer) .  The  second  method  proved  most  satisfactory — although 
a  correlation  of  0 .  73  was  found  between  group  test  and  Binet. 

Buford  Johnson  (Johns  Hopkins)  presented  an  interesting  paper  dealing  with 
mental  measurements  of  undernourished  children.  The  total  number  of  entrants  to 
the  first-grade  classes  of  a  public  school  in  New  York  City  were  measured  for  selection 
of  the  undernourished.  Out  of  the  group  of  126,  40  were  found  from  8  to  20  percent 
underweight,  with  an  average  of  11.6  percent.  These  were  segregated  into  one  class 
for  study.  A  control  group  was  formed  of  41  boys  nearest  the  normal  standard,  with 
an  average  percentage  overweight  of  0.83.  The  tests  showed  the  nutrition  group 
to  average  above  the  control  group  in  intelligence.  In  the  nutrition  group  those  with 
the  highest  intelligence  gain  weight  fastest.  It  is  concluded  that  "other  things  being 
equal,  especially  the  levels  of  intelligence,  children  from  8  to  20  percent  under  weight 
compare  favorably  with  other  children  in  mental  traits." 

Bridges  (Ohio  State  University)  presented  data  regarding  the  "Correlation  be- 
tween College  Grades  and  the  Army  Alpha  Intelligence  Tests,"  as  worked  out  from  a 
total  of  nearly  six  thousand  cases  at  Ohio  State  University.  The  correlations  averaged 
0.36.  There  were,  however,  large  variations  from  college  to  college — the  largest 
correlation,  0 .  54,  appeared,  curiously  enough,  in  the  college  of  agriculture,  the  lowest, 
0.22,  in  the  college  of  engineering.  Marked  variations  from  college  to  college  were 
also  found,  in  the  comparative  value  of  the  tests.  In  conclusion  it  was  stated  that 
"these  results  seem  to  indicate  that  intelligence  tests  for  university  students  should 
be  selected  and  standardized  for  the  different  colleges  separately,  or  that  in  addition 
to  a  general  intelligence  test  for  all  students  there  should  be  specific  tests  for  the 
students  of  the  different  colleges." 

An  important  (paper  by  Book  (Indiana  University)  dealt  with  the  "Intelligence 
of  6188  High  School  Seniors  Going  to  College."  It  was  found,  in  this  state-wide 
survey,  that  about  as  many  of  the  very  dull  as  of  the  very  bright  high-school  seniors 
plan  to  go  to  college.  However,  taking  the  groups  as  a  whole  those  intending  to  go  to 
college  rank  slightly  higher  than  those  who  do  not;  those  intending  a  liberal  arts  college 
rate  slightly  above  those  planning  a  technical  education.  Better  integration  between 
college  and  high  school  is  urged.  Two  papers  dealt  with  the  relation  of  degree  of 
Indian  blood  to  intelligence  (Hunter,  University  of  Kansas,  and  Garth,  University  of 
Texas).  In  general,  the  more  Indian  blood  the  less  score  on  the  tests.  Waugh  (Berea 
College)  gave  comparative  data  regarding  Oriental  and  American  student  intelligence. 
The  differences  were  for  the  most  part  in  favor  of  the  American  group.  Mrs.  Arlitt 
(Bryn  Mawr)  dealt  with  the  influence  of  race  and  social  status  on  the  I.  Q.  A  group 
of  Italian  children  was  found  to  average  only  slightly  above  a  negro  group,  while  a 
native  white  group  stood  out  as  clearly  superior  in  intelligence.  Also,  children  from 
homes  of  superior  social  status  scored  strikingly  higher  than  children  from  poor  homes. 
In  fact,  these  differences  due  to  social  status  were  greater  than  those  due  to  race. 
Miss  Stecher  (University  of  Iowa)  showed,  on  the  basis  of  repeated  examinations,  the 
comparative  constancy  of  the  I.  Q.  Porter  (Clark  University)  pointed  out  certain 
uses  of  group  tests  of  intelligence  in  college  and  industry. 
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Certain  miscellaneous  papers  remain  for  brief  mention.  The  tests  for  non- 
intellectual  traits  have  already  been  referred  to.  Dr.  Downey's  work  in  particular  is 
of  great  interest,  but  hardly  permits  of  adequate  description  here.  The  important 
thing  is  that  a  definite  beginning  has  been  made,  in  measurement  of  temperament, 
interest,  and  emotional  trends.  Terman  (Stanford)  gave  certain  striking  facts  regard- 
ing a  juvenile  author,  now  barely  nine,  who  composes  either  poetry  or  prose  with 
astounding  facility,  by  her  eighth  year  had  read  750  books,  had  the  vocabulary  of  a 
university  freshman.  Her  I.  Q.  is  188.  She  is  two  years  advanced  in  physical  develop- 
ment, has  exceptionally  good  health,  appears  of  normal  temperament  and  emotional 
make-up.  Last  among  these  miscellaneous  papers  may  be  mentioned  a  brief  presen- 
tation by  the  writer  of  an  examination  for  investigating  graduation  standards,  in 
departmental  school.  The  examination  consists  of  tests  in  reading  vocabulary, 
grammar  and  punctuation,  American  history,  and  arithmetical  reasoning.^ 

Following  the  annual  dinner  came  the  address  of  the  president,  S.  I.  Franz,  which 
dealt  with  recent  data  showing  the  possibility  of  relearning,  after  injury  to  various 
portions  of  the  cerebrum  in  which  certain  functions  were  supposed  to  be  exclusively 
localized.  Following  this,  reminiscences  of  Wundt  were  given  by  several  of  his  former 
students.  The  address,  the  afternoon  preceding,  of  the  retiring  vice-president  of 
"Section  I"  (Dr.  R.  M.  Yerkes)  dealt  with  the  need  for  more  adequate  psychological 
training  of  physicians.  The  symposium  consisted  quite  largely  of  the  usual  protests 
against  the  uncritical  character  of  present  work  with  tests — protests  which  are  de- 
served enough,  goodness  knows,  but  which  would  be  more  appreciated  if  they  were 
accompanied  by  constructive  efiforts  at  improvement.^ 

At  the  annual  business  meeting  thirty-five  new  members  were  voted  into  the 
association.  There  was  an  indeterminate  discussion  regarding  the  licensing  of  "con- 
sulting psychologists."  The  election  of  Professor  Margaret  F.  Washburn,  of  Vassar 
College,  as  president  for  the  next  year,  was  announced. 

It  should  be  mentioned,  in  closing,  that  a  number  of  members  of  the  Psycho- 
logical Association  presented  papers  in  the  Section  for  Education  of  the  American 
Association  for  the  Advancement  of  Science — which  has  been  reported  in  a  previous 
issue  of  this  Journal. 

S.  L.  Pressey 
Indiana  University, 

Bloomington,  Indiana 

i  Two  other  bits  of  work,  of  no  practical  interest  to  school  men,  nevertheless  have  sufficient  intrinsic 
interest  to  be  worth  mention.  Burtt  (Ohio  State)  reported  results  to  show  that  falsification  of  evidence, 
in  testifying  before  a  jury,  might  frequently  be  detected  by  peculiarities  in  the  record  of  the  breathing  of 
the  witness.  Finally,  Hull  (University  of  Wisconsin)  told  of  a  charming  bit  of  experimentation  in  which, 
for  study  of  the  effects  of  smoking,  he  had  his  subjects  smoke  a  pipe  while  blind-folded.  He  then  occa- 
sionally substituted  for  the  pipe  a  similar-drawing  mouthpiece  through  which  the  subjects  sucked  simply 
moist  not  air.  And  we  are  told  that  "confirmed  smokers  would  puff  the  warm  air  with  evident  satisfac- 
tion, and  even  go  serenely  through  the  motions  of  blowing  smoke-ringsl" 

3  The  fundamental  fact,  of  course,  is  that  we  lack  in  "pure  research"  with  tests,  because  the  older 
type  of  psychologist  has  not  been  willing  to  support  such  work. 
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RECENT  DEVELOPMENTS  IN  MEASURING 
HUMAN  CAPACITIES! 

M.  E.  Haggerty 

University  of  Minnesota 

This  association  requires  its  president  to  give  an  address. 
From  the  form  of  the  resolution  by  which  this  custom  was  inau- 
gurated it  was  obviously  the  original  intent  of  the  association 
that  the  address  should  be  a  review  of  educational  progress  in  the 
calendar  year  preceding  the  annual  meeting.  That  such  a  review 
can  be  comprehensive,  detailed,  and  critical  is  of  course  impossi- 
ble. Not  only  the  volume  of  recent  educational  literature  but  its 
diversity  of  content  and  its  range  of  method  precludes  the  accom- 
plishment of  a  purpose  so  elaborate.  The  allotted  time  requires 
a  more  restricted  project.  With  your  permission,  I  propose,  there- 
fore, to  select  a  limited  portion  of  the  field  which  might  legiti- 
mately be  included  in  such  a  review  and  to  confine  myself  to  a 
discussion  of  recent  events  in  the  attempt  to  measure  human 
capacities.  I  shall  endeavor  to  indicate  something  of  the  progress 
made  during  the  past  year,  to  point  out  certain  of  the  newer 
interests,  and  to  evaluate  our  present  status.  If  a  single  summary 
phrase  were  useful  to  indicate  the  drift  of  current  discussion  we 
might  choose  "the  Inadequacy  of  Intelligence"  as  a  suitable  title 
for  this  paper. 

Let  us  first  give  attention  to  the  extension  of  intelligence 
examinations  which  has  proceeded  with  acceleration  during  the 
year.  The  avidity  with  which  the  educational  public  has  seized 
upon  group  intelhgence  examinations  is  both  encouraging  and 
alarming.  It  confirms  our  faith  that  such  tests  meet  a  real  need 
in  school  work,  but  it  also  raises  a  doubt  as  to  the  existence  of  a 
wholesome  critical  attitude  of  mind  toward  the  proper  selecting 
of  tests  and  the  proper  use  of  test  results. 

*  Address  of  the  retiring  president  of  the  National  Association  of  Directors  of 
Educational  Research,  delivered  at  the  annual  meeting  of  the  association,  at  Atlantic 
City,  N.  J.,  March  3,  1921. 
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So  widespread  is  the  interest  in  the  measurement  of  intelli- 
gence of  young  people  in  the  schools  that  we  may  speak  of  it  as  a 
current  educational  movement.  Students  of  education  have 
devised  the  means — the  tests,  scales,  and  examinations — and 
practical  educators  are  using  them  in  the  belief  that  a  proper 
evaluation  of  the  intelligence  of  pupils  will  make  possible  impor- 
tant remedial  measures  in  teaching  and  school  organization.  It 
may  be  worth  while  briefly  to  examine  the  chief  characteristics  of 
this  movement. 

In  the  first  place  it  is  obvious  that  interest  in  the  measurement 
of  intelligence  has  been  greatly  stimulated  by  events  connected 
with  the  great  war.  For  a  decade  prior  to  that  event  there  had 
been  growing  in  the  minds  of  students  of  education  a  conviction 
that  the  results  of  formal  school  education  were  greatly  influenced 
"by  the  native  capacities  of  children.  This  conviction  was  largely 
due  to  the  growth  of  intelligence  tests  and  the  revelations  which 
such  tests  gave  of  the  wide  variabilities  in  mental  capacity  to  be 
found  among  the  school  population.  This  background  of  belief 
was  fertile  soil  upon  which  fell  the  spectacular  examination  of 
1,700,000  soldiers  by  group  intelligence  examinations  during  the 
war.  Educators  were  quick  to  see  the  possibilities  of  such  tests 
as  means  of  improving  educational  processes.  Teachers,  adminis- 
trators, and  supervisors,  as  well  as  students  of  psychology  and 
education,  have  received  the  adaptations  of  the  group  intelligence 
examination  to  school  uses  with  open  arms  and  all  too  often  with 
uncritical  acceptance  of  what  has  been  made  available. 

The  eagerness  of  the  educational  public  for  these  new  scales 
and  tests  is  evident  from  the  number  sold.  When  the  first  group 
scale  was  offered  for  commercial  distribution  the  publishers  ac- 
cepted the  offer  as  an  adventure,  printing  a  first  lot  of  10,000. 
Contrast  this  cautious  move  with  the  sales  of  the  National  Intel- 
ligence Tests  first  put  on  the  market  in  September,  1920.  More 
than  200,000  each  of  the  first  forms  of  scales  A  and  B  have  already 
been  distributed.  This  large  sale  occurs  notwithstanding  the 
rapidly  increasing  number  of  other  scales  offered  in  competition. 
It  is  probable  that  well-nigh  4,000,000  pupils  in  the  public  schools 
of  the  United  States  will  have  been  examined  by  reliable  group 
intelligence  examinations  by  the  end  of  the  present  academic 
year,  less  than  30  irionths  after  the  publication  of  the  first  scale  of 
this  t3rpe. 
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A  second  fact  to  be  noted  is  the  range  of  individuals  for  whom 
standard  group  intelligence  tests  are  now  available.  It  appears 
that  pupils  of  the  intermediate  and  grammar  grades  are  the  ones 
most  favored  in  this  respect.  There  are  at  least  a  half  dozen 
group  examinations  for  these  grades  which  give  evidence  of  meet- 
ing in  a  fair  manner  essential  statistical  requirements.  There  are 
also  a  number  of  examinations  for  the  primary  grades  and  at  least 
two  for  college  students.  For  practically  the  whole  range  of  for- 
mal education  we  have  therefore  dependable  means  of  intelligence 
measurement  with  more  than  a  dozen  separate  group  examinations 
available.  Not  all  of  these  examinations  are  the  product  of  the 
past  year.  Some  made  their  appearance  in  1919;  and  the  initial 
work  on  most  of  them  dates  beyond  a  year  ago.  But  1920  will 
be  noted  as  the  publication  year  of  a  large  number.  Of  particular 
importance  is  the  completion  and  initial  publication  of  the  Na- 
tional Intelligence  Tests  in  two  batteries  of  five  tests  each  with 
ten  forms  for  each  test. 

Again,  it  may  be  said  that  the  quality  of  intelligence  tests 
has  enormously  improved.  Five  years  ago  at  a  meeting  of  the 
American  Psychological  Association  in  Chicago  a  speaker  argued 
that  no  intelligence  test  yet  devised  had  shown  a  reasonable 
correlation  with  school  achievement  and  it  was  further  pointed 
out  that  the  several  proposed  tests  showed  but  small  inter- 
correlations  among  themselves.  There  are  numerous  tests  now 
offered  for  use  to  which  these  strictures  do  not  apply.  Inter- 
correlations  ranging  from  0.60  to  0.80  are  now  fairly  common  and 
some  reach  to  0.90,  and  more.  Correlations  with  good  measures 
of  school  achievement  are  sufficiently  high  to  furnish  a  depend- 
able basis  for  prognosis.  Continued  and  extensive  experimental 
study  has  made  possible  the  construction  of  tests  meeting  the 
essential  criteria  of  discriminative  capacity,  reliability,  signifi- 
cance, and  adequate  standards  of  comparison. 

No  claim  is  here  made  that  our  present  tests  are  finally  satis- 
factory. Sufficient  evidence  may  be  adduced  to  show  that  they 
are  not,  and  that  in  behalf  of  scientific  accuracy  we  must  go  on 
improving  these  tests,  reducing  the  sources  of  error  and  deter- 
mining the  specific  uses  to  which  particular  tests  are  best  adapted. 
The  direction  which  experimental  work  should  take  is  fairly  clear; 
certain  of  the  important  methods  are  known  and  important 
improvements  in  tests  may  be  predicted. 
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Doubtless  one  of  the  most  encouraging  facts  about  our  present 
use  of  intelligence  tests  is  the  increasing  tendency  to  utilize  test 
results  in  modifying  teaching  methods,  and  in  school  organization 
and  supervision.  In  many  American  cities  pupils  are  being  classi- 
fied on  the  basis  of  scores  made  in  these  tests,  special  classes  are 
being  organized  for  subnormal  and  gifted  children,  courses  of 
study  are  being  revised,  methods  of  instruction  are  being  changed, 
and  in  numerous  other  ways  the  assault  is  being  carried  against 
the  deadening  lockstep  and  uniformity  into  which  current  public 
educational  method  has  fallen.  That  all  of  these  changes  are  wise 
or  that  all  will  lead  to  a  better  education  is  not  assured.  But  the 
pragmatic  method  implicit  in  such  remedial  work  will  furnish  a 
corrective  to  unwise  exploitation  of  the  new  devices.  The  path  of 
progress  lies  through  just  such  remedial  efforts,  even  though  the 
immediate  outcome  may  not  be  entirely  successful. 

The  current  year  is  further  marked  by  the  effort  to  state 
achievement  in  relation  to  intelligence.  The  recent  advance  in 
the  measurement  of  intelligence  has  called  in  question  the  use  of 
achievement  tests  and  other  measures  of  school  progress.  Ob- 
viously, the  formal  school  program  should  not  be  held  responsible 
for  low  achievement  due  to  the  inferior  intelligence  of  pupils; 
neither  should  it  be  credited  with  high  achievement  due  to 
superior  intelligence.  The  wide  ranges  of  intelligence  found  in 
classes  and  schools  of  the  same  designation  show  that  the  direct 
interpretation  of  achievement  tests  does  just  this  thing.  Such 
test  results  are  only  interpretable  when  considered  in  the  light 
of  intelligence  test  results  from  the  same  pupils.  Franzen  and 
Buckingham  and  Monroe  have  proposed  methods  for  calculating 
an  "achievement  quotient"  which  will  adequately  credit  the 
school  for  capitalizing  and  paying  dividends  on  whatever  intelli- 
gence investment  it  may  have.  This  definite  recognition  of 
native  intelligence  as  a  determinative  factor  in  achievement  is 
significant  not  alone  for  the  interpretation  of  achievement  test 
results,  but  also  because  it  calls  in  question  all  those  experimental 
studies  in  the  learning  of  school  subjects  where  no  cognizance 
has  been  taken  of  the  intelligence  factor.  Such  studies — and  their 
number  is  great — must  all  be  done  over  before  any  satisfactory 
conclusions  can  be  derived  as  to  the  efficacy  of  the  other  factors 
involved. 
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The  improvement  and  extensive  use  of  intelligence  tests 
should  not,  however,  obscure  their  limitations.  To  any  careful 
experimenter  it  is  obvious  that  tests  of  the  type  currently  listed 
as  measures  of  intelligence  do  not  give  us  all  the  information 
about  children  that  we  need.  If  we  admit  that  the  so-called 
intelligence  tests  are  really  measures  of  intelligence  then  it  is 
apparent  that  success  in  school  work  and  success  in  life  are  not 
determined  by  intelligence  alone.  Other  factors  play  a  part  and  in 
many  cases  a  determinative  part  in  success  and  failure. 

Several  years  ago  two  students  working  under  my  direction 
studied  the  characteristics  of  fifty  men  who  were  admittedly  suc- 
cessful men  and  of  fifty  other  men  who  were  obviously  failures  in 
life.  Each  of  the  hundred  persons  was  rated  on  a  scale  of  eleven 
points  for  each  of  eighteen  qualities.  When  the  data  were  com- 
bined for  the  fifty  successful  men  the  results  showed  clearly  that 
in  the  combined  opinions  of  all  the  judges  the  quality  most  appar- 
ently conducive  to  success  was  industry  which  in  the  scale  was 
defined  as  "thorough,  persistent,  painstaking,  enduring"  and  the 
opposite  of  "lazy,  sluggish,  indifferent,  superficial."  The  nine 
traits  ranking  next  in  order  were  "efficiency,  attentiveness,  loyalty, 
prudence,  honesty,  adaptability,  sympathy,  tactfulness,  and  cheer- 
fulness." Only  four  of  these  nine  traits  could  by  definition  be 
construed  as  in  any  sense  equivalent  to  the  current  concept  of 
intelligence.  The  results  showed  that  the  judges  regarded  such 
non-intelligence  traits  as  industry,  loyalty,  honesty,  tactfulness, 
sympathy,  and  cheerfulness  as  weighing  heavily  in  favor  of  suc- 
cess and  such  other  non-intelligence  traits  as  self-assertion,  pride, 
conceit,  jealousy,  quarrelsomeness,  suggestibility,  and  intoler- 
ance as  weighting  individual  capacity  in  the  direction  of  failure. 

Similar  data  are  accumulating  regarding  the  capacities  of 
pupils  to  do  the  work  of  the  school.  A  few  individual  cases  may 
clarify  the  point.  For  the  past  five  years,  the  pupils  in  the  high 
school  of  the  University  of  Minnesota  have  been  examined  with 
intelligence  tests  and  the  subsequent  work  of  the  pupils  has  been 
carefully  followed  and  tested.  In  general  the  pupils  scoring 
highest  in  the  tests  make  the  highest  school  marks  but  certain 
notable  exceptions  to  this  general  rule  stand  out.  Naturally  they 
are  of  two  sorts :  those  in  which  pupils  with  high  intelligence  scores 
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make  low  marks  and  those  in  which  pupils  with  low  intelligence 
scores  make  high  marks. 

When  John  Smith  entered  the  high  school  in  the  autumn  of 
1917  he  stood  third  in  a  class  of  60  pupils  in  a  series  of  intelligence 
tests  which  included  the  following:  opposites,  analogies,  hard 
directions,  verb-object,  Trabue  completion,  and  Thorndike  reading 
scale  Alpha  2.  He  was  later  examined  with  the  Army  Examination 
A  in  which  he  scored  325  points  placing  him  easily  in  the  upper 
10  percent  of  high-school  freshmen  and  the  equal  of  many  college 
students.  On  the  Otis  scale  he  scored  179  points.  During  the 
four  years  in  high  school,  however,  only  twice  has  this  boy 
achieved  a  mark  as  high  as  C-f  on  a  five-point  scale  of  marks. 
Of  27  marks  so  far  received  twelve  have  been  D  (the  lowest  passing 
grade),  one  has  been  C  — ,  and  the  others  have  been  C.  Not  a 
teacher  who  has  had  this  boy  in  class  but  believes  him  capable  of 
much  better  work  than  he  does;  but  not  a  single  teacher  has  been 
able  to  induce  him  to  do  it. 

In  marked  contrast  to  this  boy  is  the  case  of  Mary  Jones,  a 
member  of  the  same  class,  whose  army  test  score  on  Examination 
A  was  231,  who  scored  average  on  the  initial  tests  (ranking  23 
in  the  group  of  60  entering  pupils),  and  whose  I.  Q.  (Terman) 
was  108.  Only  five  times  in  her  four  years  of  high-school  work 
has  this  girl  scored  so  low  as  B  in  an  academic  subject.  Twenty- 
eight  times  in  thirty-three  her  marks  have  been  A  and  she  is  gen- 
erally recognized  by  her  instructors  as  the  best  student  in  the 
class. 

Cases  like  these  could  be  cited  at  length.  Edgar  Brown  of 
the  present  freshman  class  whose  combined  scores  on  the  Miller 
high-school  test,  the  Terman  group  intelligence  examination, 
and  the  Haggerty  intelligence  examination  Delta  2  placed  him  in 
the  lowest  fourth  of  a  class  of  55  pupils,  achieved  rank  27  in  the 
first  quarter's  school  marks.  At  the  same  time  Ernest  Stuart, 
who  stood  in  the  upper  tenth  percentile  in  the  combined  intelli- 
gence tests,  nevertheless  fell  to  thirty-sixth  place  in  school  marks. 

One  might  infer  from  cases  like  these  that  the  tests  are  inade- 
quate to  measure  intelligence.  It  may  be  granted  that  the  inade- 
quacy of  the  tests  is  a  source  of  error  and  that  a  better  test  would 
give  a  more  accurate  prognosis  of  success  or  failure.  The  probabil- 
ities, however,  lie  in  another  direction,  namely  that  intelligence 
in  itself  is  inadequate  to  produce  success.    It  is  not  at  all  probable 
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that  a  perfect  measure  of  intelligence  would  give  a  perfect  correla- 
tion with  school  success  or  with  success  in  later  life.  A  more 
accurate  measure  of  intelligence  would  only  render  the  inade- 
quacy of  intelligence  more  apparent  for  the  simple  reason  that 
success  is  not  quantitatively  coterminous  with  intelligence  but 
with  intelligence  in  combination  with  other  significant  human 
traits  not  subject  to  evaluation  by  tests  of  the  type  currently  used 
as  measures  of  intelligence. 

Before  proceeding  to  consider  these  non-intelligence  traits  let 
us  enforce  this  idea  of  the  inadequacy  of  intelligence  by  further 
illustration, 

John  Ralph  reported  at  a  large  city  elementary  school  in 
October,  1919.  At  the  time  he  was  on  parole  from  the  state  re- 
formatory. His  history  disclosed  a  long  record  of  truancy,  incor- 
rigibility, and  lawlessness.  He  had  at  various  times  attended 
eight  different  grade  schools,  two  opportunity  rooms  for  subnor- 
mal children,  a  detention  home  for  delinquent  boys  and  the  state 
reformatory.  He  was  admitted  to  the  elementary  school  at  this 
time  on  a  special  permit  because  he  had  been  refused  admittance 
at  his  home  school  on  account  of  his  record  of  incorrigibility. 

At  the  time  of  entrance  he  was  15  years  of  age  and  was  classi- 
fied in  the  viiia  grade.  He  was  well  developed  physically,  but  his 
scholarship  was  of  exceedingly  low  quality.  He  was  placed  in  the 
department  classes  without  warning  to  the  teachers.  At  the  end 
of  the  week  the  teachers  appeared  in  a  body  in  the  principal's 
ofl&ce,  pronounced  the  boy  to  be  subnormal,  stated  that  he  was 
unable  to  do  any  of  the  work  assigned,  and  asked  the  principal 
to  have  him  sent  to  a  special  school. 

The  principal  investigated  his  case  and  discovered  that  while 
"he  could  not  write  a  good  paragraph,  nor  solve  a  problem  correctly, 
he  seemed  possessed  of  a  shrewd  practical  mind.  When  he  was 
given  a  problem  he  seemed  to  be  wholly  unfamiliar  with  the 
regular  method  of  procedure,  but  would  frequently  give  the  correct 
answer  off-hand  and  then  in  his  written  work  proceed  to  prove  his 
result.  His  English  from  the  standpoint  of  mechanics  would  have 
shamed  an  average  fourth-grade  child;  but  although  his  spelling, 
punctuation,  and  sentence  structure  were  very  poor,  his  oral  work 
showed  that  he  could  think  clearly  and  logically." 

The  boy  was  passed  into  a  group  of  pupils  to  be  examined  by 
a  psychologist  who  was  unaware  of  his  history  or  school  achieve- 
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ment.  On  the  Terman  test  the  boy  showed  an  I.  Q.  of  122  and 
was  clearly  above  average  in  mental  capacity. 

Special  courses  were  arranged  to  give  him  an  opportunity 
to  get  the  fundamentals  of  English  and  mathematics  which  he 
had  never  acquired.  He  stopped  his  cigarette  smoking  in  response 
to  the  principal's  appeal  and  the  next  day  whipped  the  biggest 
boy  in  school  who  chided  him  for  "turning  good."  He  repaired 
and  washed  up  the  principal's  automobile  and  was  allowed  to  drive 
the  car  on  errands  for  the  school.  He  was  given  many  other 
executive  responsibilities  and  proved  himself  competent  in  many 
ways.  He  graduated  at  the  end  of  the  year  and  while  he  was  not 
so  well  grounded  as  other  members  of  his  class,  he  had  attained 
a  measure  of  self-respect,  confidence  in  his  teachers,  and  a  good 
working  attitude  toward  the  school.  He  finished  the  course  with 
a  record  for  good  behavior. 

That  cases  of  this  sort  are  more  numerous  than  might  at  first 
be  supposed  is  evidenced  by  the  results  of  the  intelligence  .examina- 
tion of  94  pupils  in  a  so-called  "opportunity  school"  in  a  large 
city.  These  pupils  had  been  assigned  to  the  opportunity  school 
because  for  one  reason  or  another  they  did  not  fit  the  schools 
to  which  they  by  geographical  location  belonged.  They  ranged 
in  chronological  age  from  12  to  17  years.  They  scored  in  the 
Otis  Group  Intelligence  Scale  from  21  to  130  points.  Three 
of  these  pupils  whose  chronological  age  was  13  years  scored  126, 
128,  and  130  points  respectively,  which  places  them  in  Otis's 
genius  class;  fifteen  others  were  rated  very  superior,  or  superior, 
and  25  were  rated  as  normal.  Yet  all  of  these  45  pupils  were 
succeeding  so  poorly  in  their  school  work  that  they  had  been 
segregated  into  this  special  school.  There  is  certainly  doubt  that 
defective  intelligence  was  the  cause  of  irregularity  in  any  one  of 
the  45  cases. 

One  of  the  most  complete  demonstrations  of  the  inadequacy 
of  intelligence  is  to  be  found  in  the  Report  of  the  Laboratory  of 
Social  Hygiene  at  the  State  Reformatory  for  Women  at  Bedford 
Hills,  New  York.  The  report  is  the  result  of  six  years  of  investi- 
gation into  the  character  and  history  of  women  delinquents  in 
New  York  State  and  its  conclusions  are  based  upon  more  than 
500  case  histories  from  six  of  the  state  institutions  which  receive 
delinquent  women.    The  data  which  were  collected  and  studied 
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under  the  supervision  of  Dr.  Mabel  Fernald,  Director  of  the 
Laboratory  of  Social  Hygiene,  are  interpreted  to  show  that  "the 
average  woman  prisoner  in  New  York  State  falls  somewhat  below 
the  average  individual  in  society  in  mentality  and  in  economic 
efficiency."  The  authors  point  out,  however,  that  this  lower 
average  does  not  imply  that  delinquent  women  are  all  from  the 
lower  end  of  the  scale  of  intelligence.  "The  range  of  the  delin- 
quent group  was  found  to  be  practically  coextensive  with  that  of 
the  army  group,  our  most  representative  sampling  of  the  general 
population"  and  the  authors  further  hold  that  their  "data  fail 
absolutely  to  justify  the  view  expressed  recently  by  certain 
propagandists  that  delinquency  and  defective  intelligence  are 
practically  synonymous  and  that  solving  the  problem  of  mental 
deficiency  will  solve  the  problem  of  delinquency." 

Current  psychological  literature  multiplies  this  type  of  evi- 
dence as  to  the  inadequacy  of  intelligence.  Madsen  in  a  careful 
study  in  the  South  Omaha  High  School  showed  that  the  boys 
made  in  each  class  higher  intelligence  scores  but  lower  school 
marks  than  did  the  girls.  Colvin  finds  not  only  moderate  correla- 
tions between  school  marks  and  Otis  intelligence  scores  but  that 
60  percent  of  all  the  failures  in  the  freshman  class  of  the  Reading 
High  School  were  made  by  pupils  who  scored  normal  or  above. 
Branson  reports  that  certain  pupils  of  apparently  superior  ability 
(Otis)  fail  to  take  hold  of  the  work  as  well  as  the  rest  of  the  sec- 
tion. Buckingham  finds  intelligence  tests  insufficient  for  purposes 
of  classification.  Dickson  finds  one-fourth  of  his  accelerated 
eighth-grade  group  making  marks  below  the  average  for  the 
school.  Pressey  notes  that  "if  we  wish  to  foretell  success  in  school, 
we  must  obtain  a  measure  of  school  attitude,"  and  Terman  insists 
"that  mental  tests  should  be  supplemented  by  ratings  on  charac- 
ter traits  and  by  educational  tests." 

In  noting  the  progressive  use  of  intelligence  examinations  dur- 
ing the  past  year  it  should  be  pointed  out,  therefore,  that  there 
has  also  been  a  growing  recogaition  of  the  limitations  of  intelli- 
gence examinations  and  even  of  intelligence  itself  as  a  basis  for 
prognosis.  At  the  same  time  there  have  been  efforts  to  supple- 
ment the  measurement  of  intelligence  with  estimates  and  meas- 
ures of  the  non-intelligence  factors  contributing  to  success.  The 
direction  of  such  supplementation  is  twofold.  There  is  first  the 
effort  to  find  tests  for  special  aptitudes  as  a  basis  for  predicting 
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success  in  particular  occupational  fields.  Thurstone's  studies  in 
telegraphy,  Kitson's  studies  of  proof  readers,  Stenquist's  tests  for 
mechanical  information  are  illustrations. 

In  how  far  such  special  aptitudes  exist  apart  from  the  factors 
which  make  for  general  intelligence  is  an  unsolved  problem. 
Sufficient  evidence  is  available  to  warrant  experimental  work 
even  though  such  experimentation  promises  to  be  more  intricate 
and  difficult  than  was  the  measurement  of  intelligence. 

Along  with  emphasis  on  the  non-intellectual  factors  as  signif- 
icant for  prognosis  and  apart  from  the  experimental  work  on 
special  aptitudes  there  has  been  some  attempt  during  the  year  to 
analyze  such  factors  and  to  indicate  the  means  for  their  evalua- 
tion. The  most  tried  method  for  such  evaluation  is  the  so-called 
"rating  scale"  requiring  personal  judgments  of  non-measureable 
human  qualities.  For  the  initiation  of  this  method  as  an  instru- 
ment of  psychological  and  educational  research  we  are  doubtless 
indebted  to  Cattell  who  used  it  not  only  in  laboratory  experi- 
ments but  in  his  important  work  in  evaluating  the  individual 
worth  of  American  men  of  science.  During  the  year  Dr.  Cattell 
has  made  an  important  addition  to  his  method  by  developing 
"the  probable  error  of  a  vote"  taken  in  connection  with  the 
new  forthcoming  edition  of  this  valuable  work.  The  most  ambi- 
tious effort  to  apply  this  method  of  estimating  human  qualities 
was  the  Scott  rating  scale  for  army  officers  used  by  the  War  De- 
partment during  the  recent  war.  The  application  of  the  method 
to  educational  work  is  not  new  but  the  year  has  seen  numerous 
efforts  to  apply  the  rating  method  to  the  evaluation  of  capacities 
of  pupils  and  to  the  qualities  of  teachers.  The  Detroit  scale  for 
rating  teachers  and  the  Pressey  card  for  the  rating  of  pupils 
make  use  of  the  Scott  method. 

By  this  method  the  judge  makes  up  a  separate  rating  scale  for 
each  quality  to  be  considered.  For  the  highest  unit  on  the  scale 
the  judge  chooses  from  among  his  acquaintances  the  person  who 
in  his  opinion  possessed  that  quality  in  the  maximum  amount. 
Similarly  for  the  lowest  unit  on  the  scale  a  person  with  least 
amount  of  the  quality  is  chosen.  The  midpoint  on  the  scale  is 
located  by  selecting  a  person  who  in  the  opinion  of  the  judge 
stands  midway  between  the  highest  and  lowest  units  already 
chosen.  Other  points  may  be  interpolated  in  any  number  between 
the  ones  thus  fixed.    By  this  means  the  judge  constructs  a  rating 
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scale  whose  units  are  human  individuals  who  are  the  personal 
acquaintances  of  the  judge  himself.  Seemingly  this  device  renders 
more  concrete  the  estimation  of  human  qualities  and  Scott  has 
shown  that  in  the  rating  of  army  officers  the  probable  error  in 
judgment  is  reduced  by  the  use  of  this  type  of  scale.  Pressey 
reports  "a  coefficient  of  reliability  (of  agreement?)  of  40"  for 
different  teachers'  estimates  of  quality  of  "school  attitude,"  but 
higher  coefficients  in  the  case  of  other  traits. 

Smith  has  published  a  scale  for  the  rating  of  pupils  which  in 
his  opinion  has  considerable  validity  and  usefulness. 

Kent  criticizes  previous  teacher-rating  schemes  because  they 
place  so  little  emphasis  upon  the  results  which  teachers  achieve 
in  the  schools  and  recommends  a  rating  scale  in  which  the  achieve- 
ment of  pupils  may  count  for  as  much  as  75  points  in  a  total  of 
155  points  which  a  perfect  "professional"  worker  might  achieve. 
Connor,  who  like  Kent,  proposes  a  teacher-rating  scheme  evolved 
out  of  the  necessity  of  a  school  superintendent's  supervisory 
and  administrative  duties,  writes  that  "the  means  at  hand  for 
making  scientific  observations  of  the  progress  of  pupils  are 
scanty"  but  he  believes  such  pupil-progress  to  be  an  important 
element  in  the  rating  of  teachers. 

In  the  Virginia  survey  I  myself  used  a  rating  sheet  upon  which 
the  teachers  were  asked  to  estimate  the  scholarship,  intelligence, 
and  industry  of  their  pupils,  using  a  five-point  scale  for  each 
quality.  A  study  of  the  results  indicate  generalizations  some- 
what as  follows : 

(a)  Teachers  using  the  same  directions  differ  greatly  in  their 
ability  to  rate  the  intelligence  of  their  pupils,  (b)  In  general 
they  make  little  distinction  between  intelligence  and  scholarship, 
(c)  The  judgment  of  the  intelligence  of  a  child  is  influenced  by  the 
school  group  in  which  he  is  found.  Because  of  this  an  older  pupil 
is  usually  rated  above  his  intelligence  and  a  younger  pupil  is 
rated  below  his  capacity.  In  other  words,  teachers  rate  poor 
pupils  better  than  they  are  and  superior  pupils  as  inferior  to  their 
real  capacities,  (d)  A  group  intelligence  test  is  a  more  generally 
dependable  instrument  for  evaluating  the  intelligence,  of  a  pupil 
than  is  the  teacher's  judgment. 

A  consideration  of  all  these  rating  devices  leaves  one  with 
the  sense  of  a  problem  discovered  but  unsolved.  The  variety 
and  multiplicity  of  names  used  to  designate  traits  to  be  rated 
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is  bewildering.  Some  of  these  names  are  apparently  intended 
to  indicate  psychological  traits,  others  may  be  classed  as  social, 
others  educational,  and  still  others  relate  to  the  effect  which 
an  individual  is  able  to  produce  on  things  or  upon  other  persons. 

Thorndike  and  Knight  have  shown  by  a  study  based  on  the 
use  of  the  Scott  army  scale  and  the  Boyce  scale  for  rating  teachers 
that  there  is  a  "constant  error"  in  the  use  of  rating  scales  due  to 
the  influence  of  "a  marked  tendency  to  think  of  the  person  in 
general,"  a  tendency  which  suffuses  ratings  of  special  traits  with  a 
kind  of  halo.  "The  magnitude  of  this  constant  error  of  the  halo 
seems  surprisingly  large,"  so  large  that  the  authors  question  the 
value  of  the  ordinary  type  of  rating  scale  for  special  qualities. 

It  would  seem  necessary  to  proceed  by  the  method  of  experi- 
mental analysis  to  determine  the  group  of  traits  important  for 
rating  and  to  determine  the  logical  basis  upon  which  correct 
rating  scales  can  be  based.  It  is  further  necessary  to  evolve  by 
statistical  methods  the  types  of  units  and  the  number  of  such 
units  for  a  usable  scale,  and  finally  the  directions  for  the  use  of 
such  scales  must  be  definitely  standardized. 

While  unhappy  chaos  marks  the  present  use  of  rating  scales, 
a  glimmer  of  hope  comes  from  another  source.  During  the 
year  Dr.  June  Downey  has  published  additional  results  from 
her  "scale  for  the  measurement  of  the  volitional  pattern."  This 
scale  comprises  objective  tests,  12  in  all,  designed  to  measure 
such  personal  qualities  as  assurance,  flexibility,  speed  of  move- 
ment, motor  impulsion,  resistance,  tenacity,  coordination  of 
impulses,  freedom  from  inertia,  motor  inhibitions,  care  for  de- 
tail, speed  of  decision,  etc.  The  tests  were  first  designed  for 
individual  examination  but  are  being  adapted  to  group  use.  The 
objective  scores  are  platted  in  graphic  form  and  the  resulting 
graph  is  called  "a  will-profile."  The  author  proposes  these 
tests  as  a  supplement  to  intelligence  examination.  She  claims 
that  "the  will-profile  has  considerable  general  characterological 
significance  and  that  it  can  be  used  to  advantage  not  only  in 
getting  the  general  temperamental  pattern  of  an  individual  but 
also  in  determining  the  specific  combination  of  traits,"  and 
that  in  conjunction  with  intelligence  tests  it  "affords  in  many 
situations  a  basis  for  conservative  prophecy."  In  the  author's 
three  papers  during  the  year  she  sets  forth  the  results  of  the  tests 
with  varying  groups  and  details  a  number  of  case  studies.    The 
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method  has  been  used  in  the  psychological  laboratories  of  Cor- 
nell, Chicago,  Carnegie  Institute  of  Technology,  and  the  Univer- 
sity of  Minnesota,  It  may  develop  important  results  in  the 
measurement  of  character;  but  its  chief  claim  to  merit  so  far 
is  that  it  initiates  objective  method  in  a  field  where  our  chief 
reliance  hitherto  has  been  upon  subjective  opinion. 

These,  then,  appear  to  be  the  accomplishments  of  the  year 
in  the  field  of  mental  measurement:  the  extension  of  intelligence 
examinations  in  the  public  schools,  the  further  development 
of  rating  scales  for  teachers  and  pupils,  and  the  beginnings  of 
objective  measurement  in  the  realm  of  non-intellectual  traits. 
Certainly  no  other  year,  except  that  momentous  first  year  of 
the  great  war,  has  witnessed  more  activity  in  this  field.  We 
are  probably  right  in  believing  it  to  be  a  year  of  progress. 


THE  EFFECT  OF  CLEAR  OBJECTIVES  ON  THE  TEACH- 
ING OF  READING 

William  E.  Hawley 
Principal,  Francis  Parker  School,  Rochester,  New  York 

In  the  primary  grades  reading  is  a  vital  subject.  Teachers 
plan  their  work  with  exceeding  care;  minute  matters  are  considered 
and  given  proper  place;  system  is  evidenced  in  every  project;  ad- 
vice and  information  are  keenly  sought;  every  objective  is  clearly 
in  mind  and  every  road  carefully  charted.  Pupils  on  the  other 
hand  feel  the  urge  to  success;  they  employ  strict  attention  and 
endeavor;  failure  to  succeed  is  serious,  and  success  brings  real 
satisfaction.  In  the  upper  grades,  however,  carelessness  reigns; 
objectives  are  indistinct;  paths  of  progress  are  unexplored;  study 
of  method  is  neglected.  Imagination,  concentration,  judgment, 
and  the  memory  are  not  stretched,  although  no  other  subject 
offers  more  opportunity  for  their  development. 

Thus  the  question  arises,  what  motives  can  be  supplied  that 
will  bring  to  the  upper  grades  the  vigorous  mental  efforts  of  the 
lower  grades.  First,  the  abilities  in  reading  that  are  needed  for 
further  school  work  and  for  out-of-school  activities  must  be  more 
clearly  determined.  Second,  definite  measures  of  accomplish- 
ment, failure  to  meet  which  will  bring  shame,  must  be  established. 
Third,  more  careful  attention  to  method,  materials,  and  to  indi- 
vidual needs  must  be  given. 

The  first  of  these  needs  is  fairly  met  by  the  "Attainments  in 
Reading"  chart,^  composed  of  material  submitted  by  the  teachers 
and  compiled  for  the  Rochester  schools  by  Miss  E.  H.  MacLach- 
lan  and  a  committee  of  teachers  directed  by  Miss  Mabel  E. 
Simpson  and  Mr.  J.  P.  O'Hern.  Here  we  have,  if  they  can  be  gen- 
erally accepted,  concrete,  definite  suggestions  concerning  what  we 
should  be  attempting  in  the  elementary  grades.  Thorough  knowl- 
edge of  this  chart  would  indicate  general  appreciation  of  the  diffi- 
culty involved  in  the  satisfactory  teaching  of  reading.  In  the 
light  of  it  upper-grade  reading  cannot  continue  to  be  considered 
the  easiest  subject  to  teach.  It  challenges  effort,  preparation,  per- 
sistence; and  in  these  it  is  a  brief  as  well  as  a  decidedly  welcome 
guide.     Its  use  should  bring  emphasis  and  variety  to  the  work  and 

1  O'Hern,  Joseph  P.  "The  development  of  a  chart  for  attainments  in  reading," 
Journal  of  Educational  Research,  3:180-94,  March,  1921. 
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should  secure  the  attention  of  the  pupils  to  achievement.  An  in- 
terest in  the  growth  of  ability  to  do  the  things  demanded  by  the 
chart  may  thus  be  added  to  the  mere  interest  in  stories  read. 

Concerning  the  need  for  more  definite  standards;  it  is  now  pos- 
sible for  us  to  measure  with  a  fair  degree  of  accuracy  the  ability  to 
read  orally,  the  rate  of  silent  and  of  oral  reading,  the  ability  to 
read  short  paragraphs  and  to  react  immediately  under  instruction 
and  the  ability  to  reproduce  and  to  answer  questions  concerning 
long  paragraphs.  These  abilities  and  others  not  here  mentioned 
may  likewise  be  determined  by  the  use  of  informal  tests.  But, 
merely  the  ability  to  measure  achievement  in  reading  will  not  stim- 
ulate; the  single  giving  of  a  standard  test  will  not  necessarily  pro- 
mote progress.  Constant  checking  up  of  results  for  the  purpose 
of  charting  progress  so  that  pupils  and  teachers  are  aware  of  their 
needs  is  essential.  By  the  use  of  constant  checking  the  optimum 
achievement  in  reading  may  be  established  and  this  optimum  will 
be  demanded  and  obtained. 

Concerning  the  need  of  more  careful  attention  to  method  in  the 
upper  grades  the  general  trend  of  effort  may  be  accepted. 

The  meaning  of  the  foregoing  suggestions  is  explained  and  il- 
lustrated by  the  following  description  of  an  experiment  attempted 
at  the  Francis  Parker  School  during  the  fall  of  1919. 

In  the  spring  of  1919  the  Monroe,  Courtis,  and  Gray  reading 
tests  were  given  to  all  our  pupils.  These  tests  showed  that  our 
pupils  were  satisfactory  oral  readers,  that  the  rate  of  reading  was 
about  normal,  but  that  there  was  a  decided  limitation  in  the 
pupil's  ability  to  reproduce  definitely  and  to  answer  questions 
correctly  after  reading.  The  fifth  and  sixth  grades  were  shown 
to  be  relatively  the  poorest  readers  in  these  respects.  So  we  de- 
cided to  see  what  could  be  done  to  remedy  the  situation.  We  had 
three  sixth  grades  in  which  were  109  pupils.  We  decided  to  con- 
centrate our  efforts  for  the  entire  term  on  securing  progress  in  the 
quality  of  silent  reading.  We  were  influenced  to  this  action  not 
alone  because  our  weakness  was  just  here  but  also  from  a  con- 
viction that  ability  to  reproduce  underHes  all  success  of  the  pupils 
in  their  future  school  work.  Moreover,  we  beheved  that  the 
abiHty  to  reproduce  an  article  with  something  of  its  spirit,  its  logic 
and  its  idioms,  cannot  but  be  a  valuable  social  and  professional 
attainment.  Argument  often  depends  upon  power  to  quote  ac- 
curately from  the  thoughts  of  others.     Reproduction  requires 
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strict  concentration  and  tenacious  memory— two  attributes 
necessary  in  all  mental  effort.  So  in  thus  restricting  our  teaching 
we  were  not  unconscious  of  the  other  needs  of  reading  but  were 
merely  expressing  our  confidence  that  the  quality  of  silent  reading 
was  important. 

Our  sixth  grades  were  departmentalized  in  arithmetic,  geog- 
ra:phy,  and  English.  We  substituted  reading  for  English  and  the 
pupils  thus  had  forty  m'nutes  for  reading  each  day. 

Our  first  problem  was  to  determine  why  pupils  had  failed  in 
reproduction.  Aside  from  any  lack  of  strength  which  may  have 
been  present  in  the  teaching  we  concluded  that  one  factor  was  our 
general  policy  of  discouraging  the  use  of  the  words  of  the  text  and 
of  constantly  urging  of  pupils  to  "tell  it  in  your  own  words."  We 
cannot  enter  into  much  discussion  of  this  point.  We  decided, 
however,  that  whenever  an  effective  word  used  in  the  text  could 
be  remembered  it  should  be  used  and  that  attempts  should  be 
made  to  remember  some  of  the  more  expressive  ones.  In  addition 
we  tried  to  discourage  the  almost  universal  desire  of  pupils  to 
bring  into  reproduction  statements  that  did  not  appear  in  the  text. 
Grade  charts  showing  each  pupil's  records  were  shown  and  ex- 
plained to  the  pupils  and  we  did  what  we  could  to  encourage  them 
to  improve.  Daily  reading  for  accurate  reproduction,  required 
for  a  variety  of  purposes,  was  practiced.     Each  week  an  informal 

TABLE  I.      TWENTY  WEEKS'  PROGRESS  OF  109  SIXTH-GRADE  PUPILS 
AS  SHOWN  BY  THE  USE  OF  THE  GRAY  READING  TESTS 


Oral 
Reading 

Silent  Reading 

Rate 

(Seconds 

per  100 

words) 

Quality 

Questions 

Repro- 
duction 

Average 

First  test 

48 

42 

40 

20 

30 

Second  test 

53 

40.9 

59 

27 

43 

Percents  of  gain 

10 

2.5 

47.5 

35 

43 

Fifth-grade  standards 

48 

38.9 

32 

Sixth-grade  standards 

49 

35.8 

39 
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test  was  given  which  demanded  the  same  activities  as  the  Gray 
tests.  These  tests  were  printed,  and  copies  handed  to  each  pupil. 
At  the  end  of  twenty  weeks  the  pupils  were  retested  by  the 
Gray  tests.  About  half  of  the  pupils  were  fifth-grade  pupils  at 
the  time  of  the  first  test.  All  were  vib  and  via  pupils  at  the 
time  of  the  second  test.  Scores  were  computed  for  those  pupils 
only  who  were  members  of  the  school  at  the  time  both  tests  were 
given.  (Only  ten  of  the  109  pupils  received  a  lower  score  in 
quality  on  the  second  test  than  on  the  first.  Three  made  the 
same  score  on  each  test.)  A  summary  of  results  is  given  in  Table 
I.  These  results  indicate  that  while  the  pupils  were  increasing 
their  quality  of  reading  43  percent  under  intensive  training  for 
that  purpose,  the  sole  purpose  of  improving  quality,  they  incident- 
ally improved  in  oral  reading  five  times  as  much  as  they  normally 
would  and  at  the  same  time  made  some  improvement  in  rate. 

The  problem  of  attention  to  individual  needs  which  we  have 
mentioned  as  necessary  for  satisfactory  teaching  was  met  as  fol- 
lows: Twenty-one  of  the  poorest  readers  among  the  109  pupils  in 
these  sixth  grades  were  selected  from  their  records  on  the  first 
Gray  tests.  They  were  then  divided  into  four  groups  and  arrange- 
ments were  made  to  give  each  group  about  thirty  minutes'  special 
help  in  reading  three  or  four  times  a  week- 
Cur  first  concern  with  these  pupils  was  to  find  out  why  they 
were  unable  to  read.  We  concluded  that  poor  reading  might  be 
due  to  any  of  the  following  causes:  (1)  physical  defects;  (2)  lack 
of  knowledge  of  English;  (3)  poor  teaching  and  neglect;  (4)  lack 
of  general  intelligence;  (5)  special  disabilities  in  reading.  Exam- 
inations of  the  pupils  showed  certain  physical  defects  in  some 
cases  but  in  only  one  case  could  these  account  for  the  difficulties 
in  reading.  Only  one  pupil  was  handicapped  because  of  lack  of 
knowledge  of  English. 

We  attempted  to  diagnose  each  case  to  find  wherein  each 
pupil  was  troubled.  Let  us  digress  here  to  remark  that  diagnos- 
ing the  defects  in  reading  is  simple  compared  with  the  task  of  de- 
termining the  cause  of  those  defects.  A  doctor  may  take  the 
pulse,  measure  the  temperature  and  blood  pressure,  and  pronounce 
his  patient  ill  with  a  certain  disease;  but  it  may  take  long  study 
to  find  out  the  cause  of  the  disease.  The  symptoms  of  poliomy- 
eHtis  and  of  cancer  are  easy  to  discover  but  the  cause  still  defies 
detection.  It  is  important,  however,  to  observe  that  though  the 
cause  of  the  disease  may  not  be  known,  relief  or  even  cure  may 
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often  be  effected.  So  in  reading,  inability  to  point  out  the  cause 
of  failure  need  not  prevent  us  from  applying  measures  of  relief. 

We  had  each  of  the  twenty-one  pupils  of  whom  we  have  been 
speaking  tested  by  the  Stanford  Revision  of  the  Binet-Simon 
Test.  We  also  gave  them  the  Otis  Group  Intelhgence  Scale. 
These  tests  were  applied  in  order  to  see  to  what  extent  low  men- 
tality might  be  a  cause  of  trouble.  Our  reading  tests  and  our 
judgment  led  us  to  suspect  that  this  might  be  a  cause  in  some 
cases.  Yet  low  mentality  was  by  no  means  a  sufficient  general 
cause.  Table  II  shows  that  ten  of  the  twenty-one  pupils  (all  of 
whom  were  poor  readers)  had  intelligence  quotients  greater  than 
100.  Only  six  of  them  fell  below  90,  the  lower  limit  of  normality. 
Two  of  these  were  pupil  No.  4  and  pupil  No.  17  (Table  II).  Yet 
these  children  made  substantial  progress  in  the  interval  be- 
tween the  tests.  If  their  rather  low  I.  Q.'s  were  taken  as  a  full  ex- 
planation of  their  poor  scores  in  the  first  test,  it  would  be  difficult 
to  explain  how  they  could  make  such  progress  after  the  test. 

To  illustrate  the  attempts  to  study  individuals  we  give  the 
following  description  of  three  of  the  cases  entered  in  Table  II: 

Case  13.— A  girl  whose  age  was  14-9;  has  a  mental  age  of  11-1 
and  is  therefore  over  three  and  one-half  years  retarded;  born  in 
Holland;  lived  in  America  four  years;  never  learned  to  speak  well; 
does  not  understand  instructions  easily;  is  not  alert;  has  poor  eyes 
and  wears  glasses.  The  doctor  suggested  that  she  be  relieved  fr®m 
the  regular  gymnastic  exercises  because  of  physical  difficulties. 
The  girl  has  a  sister  in  the  school  whose  foreign  birth  could  not  be 
guessed  and  who  does  everything  well.  Teachers  feel  that  her 
health  and  lack  of  mentality  together  with  her  lack  of  Enghsh  are 
responsible  for  her  poor  reading. 

Case  16. — A  boy  whose  age  was  11-1;  has  a  mental  age  of  12 
years;  has  no  physical  defects;  has  a  fine  home  and  unusually  in- 
telligent parents;  does  arithmetic  well  and  succeeds  in  other  sub- 
jects; no  apparent  cause  for  poor  reading;  reported  that  he  knew  he 
could  never  read  and  that  he  did  not  like  to  try;  his  father  had 
tried  to  help  him  but  without  success;  nevertheless  he  did  well  on 
the  test.  Asked  at  the  end  of  the  term  how  he  could  make  so 
much  progress,  he  reported  that  it  was  because  of  the  general  in- 
terest of  the  grade  in  reading  and  because  his  teacher  helped  him 
specially.  He  said  that  he  had  read  his  first  book  at  home,  the 
Swiss  Family  Robinson,  that  he  liked  it  and  that  he  was  then 
reading  a  boy^scout  book. 
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Case  5. — A  boy  whose  age  was  14-1;  has  a  mental  age  of  12-4 
years;  read  with  diflSculty  the  simplest  words;  has  very  nearly 
been  abandoned  in  so  far  as  hope  of  teaching  him  to  read  is  con- 
cerned; was  interested  in  the  records  of  the  grade;  very  much 
wished  to  improve;  for  three  years  he  had  had  difficulty  in  seeing, 
which  had  not  been  discovered;  could  do  arithmetic  if  some  one 
would  read  the  problems  but  could  not  solve  a  single  problem  if 
compelled  to  read  it  for  himself;  his  low  mentality  had  evidently 
given  him  a  poor  start  and  his  difficulties  had  increased  from 
grade  to  grade.  It  seems  that  he  is  also  the  one  out  of  the  109 
pupils  who  has  some  special  disability  in  reading.  What  the 
difficulty  is  we  do  not  know.  It  evidently  has  to  do  with  the  rate 
of  comprehension.  At  the  end  of  the  term  he  said  that  he  had 
read  a  complete  book,  that  he  liked  it  and  that  he  was  beginning 
to  read  rapidly  enough  to  enjoy  the  story.  He  added,  "My 
parents  are  surprised  to  hear  me  read  from  the  newspaper." 

The  details  of  the  devices  used  for  improvement  cannot  be 
given  here.  The  teachers  employed  word  drills,  sandtables, 
progress  charts,  home  reading  of  assignments  with  written  repro- 
ductions and  weekly  tests.  The  pupils  made  joke-books,  asked 
questions,  read  for  visitors,  dramatized  and  discussed  their  own 
achievements.  Emphasis  and  variety  were  the  watchwords.  The 
error  in  attempting  to  judge  reading  merely  by  hearing  pupils 
read  can  be  judged  by  this  study. 

In  previous  years  our  efforts  had  been  expended  largely  upon 
oral  reading  without  attaining  a  high  degree  of  success.  When 
the  emphasis  was  shifted  to  silent  reading  for  meanings,  the  oral 
work  improved  decidedly. 

One  conclusion  to  be  drawn  is  that  the  excuse  of  pupils  being 
"poor  material"  is  a  poor  one.  A  second  conclusion  is  that  if 
pupils  have  definitely  established  standards  toward  which  to  work, 
pride  will  enter  in  and  the  work  will  improve.  On  the  other  hand, 
while  mental  and  physical  defects  are  to  some  extent  the  cause  of 
poor  reading  ability,  nevertheless,  standards,  frequent  testing, 
and  special  help  from  the  teacher  will  result  in  better  reading  in 
spite  of  these  defects.  Still  another  conclusion,  and  perhaps  the 
most  important,  is  that  an  effort  to  improve  the  quality  of  read- 
ing in  a  grade  will  result  in  a  general  improvement  in  oral-reading 
attainment  and  ability  to  reproduce. 


AN  EXPERIMENT  WITH  THE  OTIS  GROUP  INTELLI- 
GENCE SCALE  IN  THE  NEEDHAM,  MASSACHU- 
SETTS, HIGH  SCHOOL 

RoscoE  L.  West 
Superintendent  of  Schools,  Needham,  Massachusetts 

Group  intelligence  tests  are  being  used  for  various  purposes: 
to  divide  a  school  or  class  into  divisions  according  to  ability,  to 
aid  in  guiding  a  pupil  in  his  selection  of  courses,  to  give  teachers 
information  concerning  pupils,  and  so  on.  One  object  in  the  ex- 
periment described  here  was  to  see  if  these  tests  could  be  used  to 
stimulate  pupils  capable  of  doing  good  work  to  live  up  to  their 
capabilities.  It  was  felt  that  this  would  be  a  very  practical  bene- 
fit and  that  if  the  tests  could  be  used  for  this  purpose  they  would 
be  of  constant  value  in  improving  the  standard  of  work  of  many 
pupils. 

On  December  29,  1919,  the  Otis  Intelligence  Scale  (Form  A) 
was  given  to  173  high-school  pupils  divided  as  follows:  grade  xii, 
26  pupils;  grade  xi,  27  pupils;  grade  x,  46  pupils;  grade  ix,  74 
pupils. 

In  order  that  the  test  might  be  given  simultaneously,  the  whole 
school  was  divided  into  five  sections.  These  sections  were  given 
the  test  by  the  superintendent  of  schools,  the  high-school  prin- 
cipal, and  three  teachers.  The  test  had  first  been  given  to  the 
teachers  by  the  superintendent;  and  the  procedure  and  methods 
had  been  discussed  so  that  conditions  might  be  as  nearly  uniform 
as  possible. 

Medians  and  ranges  in  the  Otis  Group  Intelligence  scores 
(Form  A)  are  indicated  in  Table  I. 

TABLE  I.   RESULTS  OF  OTIS  GROUP  INTELLIGENCE  SCORES,  FORM  A 


Grade 

Median 

Range 

XII 

XI 

X 

rx 

164 
159 
143 
129 

209    to      90 
183    to    104 
205    to      61 
191    to      70 

261 


262 
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In  order  to  secure  an  accurate  record  and  to  make  some  com- 
parisons, Form  B  was  given  on  January  16  with  the  medians  and 
ranges  as  indicated  in  Table  II. 

TABLE  II.   RESULTS  OF  OTIS  GROUP  INTELLIGENCE  SCORES,  FORM  B 


Grade 

Median 

Range 

XII 

XI 

X 

rx 

182 
175 
160 
151 

206    to    109 
191    to    121 
210    to      80 
200    to      82 

The  records  for  Form  B  are  distinctly  higher  than  those  for 
Form  A,  due  probably  to  the  familiarity  with  procedure  acquired 
in  the  first  test.  The  average  difference  between  the  medians  of 
Forms  A  and  B  is  18  points.  The  relative  positions  of  the  pupils 
were,  however,  about  the  same  in  the  two  tests  as  shown  by  the 
correlations  between  Form  A  and  Form  B  in  Table  III. 


TABLE  III.   CORRELATIONS  BETWEEN  FORM  A  AND  FORM  B 


Grade 

Correlation 
Coefficients 

XII 

XI 

X 

IX 

0.92 
0.89 
0.95 
0.91 

These  high  correlations  indicate  that  the  two  forms  test  the 
same  things. 

Another  set  of  figures  (shown  in  Table  IV)  was  made  up  to 
compare  the  records  of  pupils  of  various  ages  in  the  different 
grades. 

Table  IV  shows  clearly  that  the  youngest  pupils  in  the  grade 
made  the  best  records.  With  one  or  two  exceptions  (where  only 
one  pupil  is  in  a  group)  the  scores  decrease  as  the  age  increases. 
Upon  examination  of  the  scores  of  pupils  of  the  same  age  in  dif- 
ferent grades  it  is  found  that  the  highest  scores  in  each  case  are 
found  in  the  highest  grades.  For  instance,  the  sixteen-year-old 
pupils  in  grade  xii  score  168,  while  those  who  are  16  in  grade  xi 
score  152,  in  grade  x,  139,  and  in  grade  ix,  115.  These  results  indi- 
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TABLE  IV.      COMPARISON  OF  RECORDS  AND  AGES  IN  GRADES  XII-IX, 
FORM  A,  OTIS  SCALE 


GSADI 

Age 

XII 

XI 

X 

rx 

Number 

Average 
Score 

Number 

Average 
Score 

Number 

Average 
Score 

Number 

Average 
Score 

13 

8 
27 
26 
10 

3 

137 

14 

1 
13 
20 
10 

2 

140 
155 
139 
125 
120 

135 

15 

2 

9 

14 

1 

1 

174 
152 
151 
145 
104 

118 

16 
17 
18 

3 

12 

8 

2 

1 

168 
168 
156 
127 
135 

115 
113 

19 

20 

cate  that  the  pupils  of  high  intelligence  have  been  able  to  complete 
the  elementary  school  in  less  time  than  those  of  lesser  intellectual 
capacity.  The  retardation  of  the  older  pupils  is  evidently  accom- 
panied by  a  certain  lack  of  intelligence. 

The  next  problem  considered  was  the  correlation  between  the 
intelligence  tests  and  the  teachers'  marks.  For  this  purpose  the 
marks  given  during  the  fall  term  (two  periods  of  eight  weeks  each) 
were  considered.  When  the  average  of  the  Otis  scores  (Form  A 
and  Form  B)  and  the  marks  were  related,  the  correlation  coeflGi- 
cients  were  found  to  be  as  follows:  grade  xii,  0.66;  grade  xi,  0.59; 
grade  x,  0.55;  grade  ix,  0.58. 

These  correlations  are  fairly  high  and  show  a  marked  tendency 
for  the  distribution  of  teachers'  marks  to  arrange  themselves  ac- 
cording to  intelligence  as  shown  by  the  tests. 

We  then  prepared  diagrams  which  showed  how  each  pupil 
ranked  in  relation  to  the  other  members  of  his  class  both  in  the 
intelligence  test  and  in  his  marks.  Naturally  some  pupils  were 
higher  in  marks  than  in  intelligence  and  some  lower.  We  felt 
that  we  did  not  need  to  worry  about  the  pupils  whose  work 
graded  higher  than  their  intelligence.  The  most  outstanding  cases 
of  this  kind  were  discussed  to  see  if  the  teachers  were  giving  too 
high  marks.  In  each  case  the  superior  rating  in  school  work  was 
interpreted  as  being  due  to  hard,  conscientious  application  on  the 
part  of  the  pupil. 
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TABLE  V.      RELATIVE  RANKING  OF  TWENTY-TWO  SELECTED  PUPILS 
IN  THE  INTELLIGENCE  TEST  AND  IN  MARKS 


GVAPX 

Pupn- 

Otis  Rank 

MabxRank 

Reason  for  Dlfference 

NUMBEE 

IN  Class 

IN  Class 

xn 

1 

2 

13 

Outside  work 

2 

5 

17 

Slowness 

3 

17 

24 

Absence  due  to  social  ac- 
tivities 

XI 

4 

3 

14 

Outside  interests  and  lack 
of  study 

5 

5 

20 

Diffidence  and  lack  of 
knowledge  of  how  to 
study 

X 

6 

4 

18 

Lack  of  study 

7 

5 

30 

Absence  due  to  home  con- 
ditions 

8 

17 

37 

Uninterested,  perhaps  due 
to  poor  health 

9 

10 

22 

Too  interested  in  social  ac- 
tivities 

10 

18 

31 

Absence  due  to  social  ac- 
tivities 

11 

21 

35 

Absence  due  to  home  con- 
ditions 

DC 

12 

1 

15 

Lack  of  ambition  and  ap- 
plication 

13 

4 

29 

Doesn't  know  how  to 
study — can't  follow  di- 
rections 

14 

13 

53 

Chronic  laziness 

15 

7 

26 

Slowness  in  written  work 

16 

5 

22 

Laziness — frequent  ab- 
sence 

17 

9 

39 

Indifference 

18 

17 

58 

Absence  due  to  home  con- 
ditions 

19 

18 

63 

Doesn't  try — seems  im- 
mature 

20 

34 

57 

Wastes  time  in  dreaming 

21 

12 

27 

Lack  of  ambition 

22 

25 

42 

Immaturity 
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We  then  selected  the  most  glaring  cases  of  pupils  who  in 
marks  were  below  their  relative  ranking  in  the  intelligence  test. 
Twenty-two  of  the  thirty-one  pupils  selected  for  study  remained 
throughout  the  year  so  that  comparisons  with  their  marks  during 
the  last  two  periods  of  the  year  could  be  made.  These  twenty- 
two  cases  were  discussed  in  a  meeting  of  the  teachers  to  find  out 
why  the  teachers  thought  they  were  not  doing  work  of  which  they 
were  capable.  Table  V  shows  the  relative  ranking  of  the  pupils, 
both  in  the  intelligence  test  and  in  marks.  It  also  gives  the  prin- 
cipal reasons  assigned  by  the  teachers  for  poor  work. 

The  amount  of  differences  in  ranks  in  the  classes  and  the  av- 
erage difference  is  given  in  Table  VI. 


TABLE  VI. 

SUMMARY  OF  DIFFERENCES  IN 

RANKS 

Total  of  Differences 

Grade 

Pupils 

in  Position 

XII 

3 

30 

XI 

2 

26 

X 

6 

98 

IX 

11 

286 

Total 

22 

440 

Average  difference  in  position:  20 

Table  VI  indicates,  therefore,  that  these  22  pupils  averaged  20 
positions  lower  in  their  ranking  by  marks  than  by  the  intelligence 
test. 

It  is  evident,  however,  that  the  opportunity  for  displacement 
in  relative  ranking  in  a  small  class  is  not  equal  to  that  in  a  large 
class.  For  example  the  margin  separating  the  eighteenth  from 
the  nineteenth  pupil  in  a  class  of  26  is  larger  than  the  margin  be- 
tween the  eighteenth  and  nineteenth  pupils  in  a  class  of  74.  The 
figures  should,  therefore,  be  reduced  to  a  common  basis  if  statis- 
tics covering  them  all  are  to  be  of  value.  It  would  seem  to  be 
easiest  to  reduce  all  classes  to  a  basis  of  grade  ix  in  which  there 
were  74  pupils.  To  do  this,  we  may  simply  multiply  the  rankings 
given  in  Table  V  by  the  quotient  found  by  dividing  74  by  the  num- 
ber in  each  class.  These  quotients  are  2.8  for  grade  xii,  2.7  for 
grade  xi,  and  1.6  for  grade  x.  The  rankings  adjusted  by  this 
method  give  the  differences  in  positions  shown  in  Table  VII.  Ac- 
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cording  to  this  adjustment  the  differences  in  position  were  such 
that  if  each  of  the  three  smaller  classes  had  been  enlarged  to  74 
pupils,  without  changing  its  characteristics,  each  pupil  would 
have  averaged  27  ranks  lower  in  marks  than  in  intelligence  score. 


TABLE  VII.      ADJUSTED  DIFFERENCES  IN  POSITIONS 


Grade 

Pupils 

Adjusted  Differences 
in  Position 

xn 

XI 

X 

IX 

3 

2 

6 

11 

84 

70 

157 

286 

Total 

22 

597 

Average  difference  in  position:  27. 1 

After  these  facts  were  compiled  a  letter  was  sent  to  the  parents 
of  each  of  these  22  pupils  explaining  the  intelligence  test,  the  dif- 
ference in  standing  between  the  pupil's  ranking  in  this  and  in  his 
marks,  and  the  reason  assigned  by  the  teachers  for  this  poor  show- 
ing. The  parents  were  asked  to  aid  the  school  in  bringing  these 
pupils  nearer  to  their  proper  standing  as  shown  by  their  intelli- 
gence records.  Table  VIII  shows  the  relative  standing  of  the 
pupils  in  the  Otis  test  and  in  their  marks  for  the  first  two  periods 
and  for  the  last  two  periods  of  the  year.  It  should  be  noted  that 
the  rankings  are  given  as  adjusted  to  the  class  of  74  pupils. 

Sixteen  pupils,  as  shown  in  Table  VIII,  gained  in  position 
from  two  to  thirty  points.  The  total  gain  was  176  points  or  11 
per  pupil.  Six  pupils  showed  a  loss  of  53  points  or  8.8  per  pupil. 
For  the  entire  twenty- two  the  net  gain  was  123  points  or  5.5  per 
pupil. 

This  investigation  shows  that,  of  the  pupils  making  the  largest 
gains,  numbers  7,  9,  and  10  were  pupils  whose  poor  work  seemed  to 
be  due  to  home  or  social  activities,  matters  which  could  be  cor- 
rected. Number  5  was  reported  as  lacking  knowledge  of  how  to 
study.  Special  attention  was  given  to  aid  her  in  her  study  habits 
with  a  resulting  gain  of  30  points  in  her  standing.  Number  15, 
who  was  reported  as  slow  in  written  work,  had  probably  been 
marked  unfairly  because  some  teachers  did  not  appreciate  his  real 
ability.    The  four  pupils  who  made  the  largest  losses,  numbers 
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TABLE  VIII.      RELATIVE   STANDING  OF  PUPILS  IN  OTIS   SCALE  AND 
IN  MARKS  FOR  FIRST  AND  SECOND  PERIODS 


Ranks  on  Teach- 

Teachers'Marks 

Grade 

Pupil 

Otis 

ers'  Mat?ks 

Gain 

Loss 

in  Peecents 

Gain 

Loss 

Rank 

First 

Second 

First 

Second 

XII 

1 

6 

36 

34 

2 

83.5 

85.2 

1.7 

2 

14 

48 

31 

17 

78.8 

86.1 

7.3 

3 

48 

67 

70 

3 

73.3 

77.7 

4.4 

XI 

4 

8 

38 

35 

3 

79.3 

77.1 

2.2 

5 

14 

54 

24 

30 

74.4 

80.6 

6.2 

X 

6 

6 

29 

27 

2 

76.5 

75.2 

1.3 

7 

8 

48 

19 

29 

69.7 

78.5 

8.8 

8 

27 

59 

56 

3 

63.6 

62.6 

1. 

9 

16 

35 

21 

14 

74.8 

78.4 

3.6 

10 

29 

50 

31 

19 

71.0 

73. 

2. 

11 

34 

56 

53 

3 

68.4 

66.7 

1.7 

DC 

12 

1 

15 

30 

15 

82.5 

77.3 

5.2 

13 

4 

29 

27 

2 

79.5 

80.1 

0.6 

14 

13 

53 

61 

8 

70.5 

63.7 

6.8 

15 

7 

26 

10 

16 

80.2 

87.1 

6.9 

16 

5 

22 

18 

4 

82.7 

83.1 

0.4 

17 

9 

39 

46 

7 

75.5 

72.6 

2.9 

18 

17 

58 

60 

2 

69. 

64.7 

4.3 

19 

18 

63 

52 

11 

67.2 

69.7 

2.5 

20 

34 

57 

47 

10 

70. 

72.2 

2.2 

21 

12 

27 

45 

18 

80. 

73.1 

6.9 

22 

25 

42 

31 

11 

74.2 

76.7 

2.5 

12,  14,  17,  and  21,  were  reported  as  "lacking  ambition,"  "lazy," 
and  "indifferent."  Evidently  these  drawbacks  were  not  corrected 
by  the  methods  used  as  the  last  standing  was  worse  than  the  first. 
These  special  notes  show  how  the  tests  can  be  used  to  foUow  up 
individual  cases. 

The  average  of  all  the  pupils  for  the  first  period  was  74.7  per- 
cent and  for  the  last  period,  75.5  percent;  a  gain  of  only  0.8  percent. 
This  is,  however,  of  little  significance  unless  we  know  how  the 
marks  of  all  the  other  pupils  compared.  The  figures  given  as  to 
relative  standing  in  the  class  are  of  more  significance.    These 
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TABLE  IX.      CHANGES   IN   TEACHERS'   MARKS   BETWEEN   THE   FIRST 
AND     SECOND     PERIODS 


Grade 

First  Mark 

Second 
Mark 

Gain 

Loss 

XII 

78.5 

83.0 

4.5 

XI 

76.8 

78.8 

2.0 

X 

70.7 

72.4 

1.7 

IX 

75.6 

74.6 

1.0 

figures  show  that  the  sixteen  pupils  who  gained  made  a  consider- 
able increase.  Of  the  six  who  lost,  two  brought  the  record  down 
very  much  by  losing  15  and  18  places  respectively.  It  seems, 
therefore,  very  safe  to  say  that  intelligence  tests  will  be  found  use- 
ful as  one  factor  in  stimulating  pupils  to  the  best  work  of  which 
they  are  capable. 

The  results  of  this  experiment  may  be  summarized  as  follows : 

1.  There  was  a  very  high  correlation  between  Forms  A  and  B 
of  the  Otis  Scale. 

2.  There  was  a  fairly  high  correlation  between  the  Otis  test 
and  the  teachers'  marks. 

3.  There  was  a  very  definite  tendency  for  the  youngest  pupils 
to  make  the  best  records. 

4.  A  considerable  gain  was  produced  by  using  these  tests  with 
22  pupils  to  bring  their  work  up  to  a  standard  nearer  that  shown 
by  the  results  of  the  intelligence  test. 


RAYMOND:    A  CASE  STUDY  ILLUSTRATIVE  OF  THE 

DIAGNOSTIC  LIMITATIONS  OF 

A  QUANTITATIVE  SCORE 

Bernice  Leland 
Marr  School,  Detroit  Teachers  College 

The  case  of  Raymond  is  presented  here  as  suggestive  of  a  class 
of  children  whose  departure  from  the  accepted  standards  of  be- 
havior and  proficiency  makes  them  conspicuous  problems  in  the 
schoolroom.  A  surprising  discrepancy  is  observed  between  the 
demonstrated  ability  of  these  children  to  learn  school  subjects 
by  the  usual  school  methods  and  an  intelligence  quotient,  deter- 
mined on  such  a  scale  as  the  Binet.  The  educational  prescription 
can  be  most  effectively  determined  by  the  analytical  consideration 
of  the  child  in  his  efforts  to  learn,  such  a  study  supplementing  the 
tests  and  completing  the  diagnosis. 

Raymond  has  been  under  careful  observation  and  special  in- 
struction for  twelve  school  months,  the  educational  procedures 
varying  as  one  failed  and  another  seemed  feasible.  He  is  now 
(September,  1920)  eight  years  and  nine  months  old  and  has  been 
in  school  without  long  absences  since  he  was  five.  His  intelli- 
gence quotient  (Binet)  in  June,  1920,  was  105. 

So  difficult  and  uncertain,  however,  is  the  process  of  learning 
school  subjects  that  he  has  made  comparatively  little  progress. 
In  June,  he  scored  2  on  Haggerty's  Achievement  Test,  Sigma  1, 
and  1  on  Test  2.  When  school  closed  he  had  read  with  great  effort 
some  fifty  pages  of  a  first  reader.  Now,  three  months  later,  he 
can  scarcely  read  acceptably  the  primer  which  preceded  the  other 
book  and  which  he  must  have  first  encountered  over  two  years 
ago.  He  writes  very  well,  forming  the  letters  with  care.  He 
does  not  copy  accurately,  however,  omitting  and  substituting 
letters.  He  has  acquired  a  few  number  facts;  but  he  is  not  keen 
at  problems,  answering  impulsively  and  without  much  delibera- 
tion. His  spelling  vocabulary  is  very  limited  and,  like  all  of  his 
school  performances,  erratic-fair  today,  impossible  tomorrow. 
He  is  fond  of  stories,  but  takes  little  part  in  language  activities. 
As  he  talks,  his  lips  tremble  and  his  voice  is  forced  as  though  his 
jaws  were  set.    He  is  not  timid. 

An  observer  characterizes  him  at  once  as  "queer  looking." 
His  ears  are  prominent  and  his  thin  little  body  supports  a  head 
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disproportionate  in  size  and  slightly  brachycephalic.     His  blue 
eyes  are  very  wide  open  and  he  works  feverishly. 

There  are  days  when  the  dynamics  of  an  idea  carry  him  into 
appropriate  action  with  such  sudden  discharge  that  he  is  up  and 
gone  before  one  can  stop  him.  As  he  dashes  into  the  hall,  his 
teacher  calls,  "Raymond,  it  is  nearly  recess  time.  Shall  we  wait 
for  a  few  m'nutes?"  He  always  agrees  readily,  and  settles  down 
to  his  work  without  the  slightest  display  of  discomfort.  Again, 
he  seizes  his  pencil,  making  a  precipitate  dash  for  the  sharpener 
In  the  midst  of  what  appears  to  be  close  application  to  his  assign- 
ment, the  idea  of  drawing  pictures,  which  he  does  with  fair  skill, 
or  of  making  paper  furniture  perhaps,  gains  ascendancy.  Ray- 
mond discards  all  else  and  is  presently  seen  suiting  the  action  to 
the  idea. 

A  situation  requiring  organization  and  the  focusing  of  certain 
competencies  for  the  achievement  of  an  unaccustomed  end  is  a 
very  difficult  one  for  Raymond.  He  can  neither  persist  along  a 
certain  line  for  any  considerable  time  nor  can  he  muster  his  forces 
efficiently  at  the  start.  Given  a  paper,  upon  which  appear  two 
or  three  simple  questions  and  the  number  of  the  page  upon  which 
the  answers  may  be  found,  he  is  occupied  for  some  time;  but  he 
accomplishes  nothing,  although  it  is  determined  that  the  task  is 
not  beyond  either  his  reading  ability,  meager  as  it  is,  or  his  compre- 
hension.    He  is  always  "just  going  to  do  it." 

This  mental  inefifectiveness  has  resisted  all  attempts  at  correc- 
tion. It  results  in  an  exceedingly  limited  daily  output,  and  has 
been  an  emphatic  obstacle  to  his  educational  progress.  There  is 
no  malice  in  his  conduct.  He  does  the  best  he  can,  and  he  is 
pitifully  conscious  at  times  of  his  failures. 

The  retentive  phase  of  Raymond's  memory  is  conspicuously 
disturbed.  "Where  is  your  book,  Raymond?  Boys  in  this  class 
need  their  books  every  day,  you  know."  After  a  search  for  the 
missing  reader,  he  laughs  and  explains  that  he  had  left  it  "out  in 
the  hall  on  the  top  step."  A  futile  trip  to  the  stairway  follows. 
"You  must  find  your  book,  Raymond,  now."  Bewildered  and 
excited  he  dashes  out  of  the  room  and  presently  we  see  him  pass 
the  window  on  the  run.  The  book  was  at  home  and  when  he 
finally  remembered  where  it  was  he  had  intelligence  enough  to  go 
after  it  without  consulting  anyone.  This  is  a  typical  reaction. 
School  material,  notes  or  forms  to  be  signed  by  his  parents  and 
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returned,  rubbers  or  asweater  to  be  taken  home,  all  slip  through 
his  memory  like  water  through  a  sieve.  He  even  forgets  that  he 
has  not  finished  his  assignment  of  work  and  merrily  engages  in 
some  other  pursuit  after  an  interruption  for  a  reading  lesson. 

This  unfortunate  lack  of  retentiveness  displayed  in  the  every- 
day affairs  of  his  life  is  emphasized  for  symbols,  particularly  words. 
His  associations  are  weak  and  any  system  intended  to  teach  a 
reading  vocabulary  by  rote  learning,  therefore,  holds  no  advan- 
tage for  Raymond.  When  he  comes  upon  a  word  which  he  can- 
not recognize,  he  cannot  remember  where  he  saw  it  before,  where 
he  heard  it  or  read  it  last,  nor  where  in  his  book  to  look  for  the 
sentence  if  he  could  keep  in  mind  such  a  prop  to  lean  upon.  We 
have  tried  writing  the  word,  saying  it  aloud  at  the  same  time, 
spelling  it,  and  calling  attention  to  details  such  as  "two  t's  in  the 
middle"  of  the  word.  We  have  used  pictures,  alphabet  cards, 
word  cards,  sentence  strips,  flash  cards,  and  what  not  to  stimulate 
in  every  way  for  a  given  word.  We  have  worked  on  phonetic 
words,  and,  as  he  has  no  difiiculty  with  blending,  he  gets  along 
fairly  well  for  a  time.  Then,  without  warning,  he  may  begin  the 
application  of  phonics  to  every  word  he  sees — and  English  is  not 
a  consistently  phonetic  language.  All  our  efforts  to  reinforce 
weak  visual  imagery  avail  us  nothing.  Raymond  cannot  read. 
Furthermore,  he  seems  to  have  an  "idiosyncracy"  for  certain 
words,  particularly  "spring."  Special  emphasis  has  again  and 
again  been  given  it,  and  he  has  had  months  of  experience  with 
books  in  which  it  occurs  often.  If  the  word  were  presented  to 
him  at  this  moment,  the  chances  are  about  even  that  he  would  not 
know  it.  Doubtless  faulty  attention  explains  some  of  this,  but 
some  special  disability  adds  to  the  sum  total  of  his  handicaps. 

It  is  interesting  to  note  the  father's  statement.  He  says  that 
Raymond  is  "just  like"  himself.  He  is  a  broker  and  has  resorted 
to  a  system  of  "memory  training"  because  he  could  not  remember 
his  price  lists.  He  undertook  to  teach  his  son  to  read  by  this 
same  device.     He  admits  that  the  plan  was  a  failure. 

Visual  imagery  not  concerned  with  symbols  seems  to  be  ade- 
quate. Raymond  possesses  a  certain  manual  dexterity  which 
enables  him  to  construct  paper  toys  nicely  without  a  copy,  to 
build  with  blocks,  and  to  handle  tools  for  simple  woodwork.  But 
his  resources  are  soon  exhausted  and  he  resorts  to  building  the 
same  thing  day  after  day.  Last  spring  he  made  pin-wheels  every 
afternoon  for  days  after  we  had  each  made  one  to  take  home.    At 
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last  we  aimed  his  ideas  in  another  direction  and  he  became  an 
ardent  builder  of  garages. 

On  the  Binet  scale  in  June,  1920,  he  failed  on  the  following 
tests:  eight-year — counting  backwards;  nine-year — date,  making 
change,  repeating  four  digits  backwards;  ten-year — all  except 
the  absurdities.  One-half  of  the  design  (a)  was  correct.  (In 
September,  1919,  the  other  half  of  the  design  was  correct.)  His 
plan  for  the  ball  and  field  was  a  spiral. 

His  basal  age  was  seven  years;  his  mental  age  was  eight  years 
and  nine  months.  This  quantitative  expression  of  results  is  not 
an  adequate  statement  of  the  situation.  The  emotional  insta- 
bility which  Raymond  exhibits  is  not  a  determining  factor  in  the 
test,  nor  is  the  memory  disability.  His  attention  is  persistent 
enough  for  each  test,  and  his  trainability  for  facts  is  high  enough 
so  that  in  his  nearly  nine  years  of  existence  he  has  acquired  enough 
information  to  carry  him  through.  It  requires  a  qualitative 
analysis  of  behavior  to  set  forth  the  facts  in  the  case. 

We  do  not  know  the  cause  of  the  boy's  condition,  but  we  have 
a  theory.  We  know  that  he  was  not  physically  perfect  at  birth, 
a  slight  operation  being  necessary  before  micturition  could  be  ac- 
complished. We  know  that  he  was  frail,  "almost  had  the  rickets," 
and  did  have  acute  adenitis  when  one  year  old. 

After  a  Herculean  effort  on  our  part,  his  parents  were  per- 
suaded in  November,  1919,  to  have  his  tonsils,  which  had  been 
badly  diseased  for  a  long  time,  removed.  At  the  same  time,  the 
dentist  extracted  eight  ulcerated  teeth.  Raymond  was  then 
seven  years  and  ten  months  old.  We  were  encouraged  by  the  fact 
that  he  was  calmer  after  this,  and  that /or  the  first  time  in  his  life, 
he  was  persuaded  to  eat  solid  food.  We  very  soon  found,  how- 
ever, that  he  resisted  learning  just  as  before,  and  that  he  was 
equally  unstable  at  times;  though  it  is  true  that  such  times  were 
somewhat  less  frequent. 

Six  months  after  this  experience,  Raymond  weighed  48.5 
pounds,  was  48.8  inches  tall,  and  a  physician  diagnosed  his  case  as 
one  of  vegetative  hypotonia.  After  four  months  of  delay,  the 
parents  have  not  yet  adopted  the  vitamine  feeding  prescribed,  and 
we  believe  that  the  boy's  nervous  system  is  so  devitalized  by  dis- 
ease and  lack  of  proper  nourishment  that  he  presents  a  clinical 
picture  of  irremediable  mental  defect.  If  there  ever  was  a  time 
when  the  nervous  mechanism  could  have  been  aided  to  make  a  har- 
monious and  consistent  contribution  toward  standard  behavior, 
we  fear  that  time  has  passed. 


RATING  THE  GENERAL  APPEARANCE  OF  PRIMARY 
NUMBER  WORK         u] 

Ernest  C.  Witham 
Superintendent  of  Schools,  Southington,  Connecticut 

Professor  Bagley  says  in  his  book  on  classroom  management 
that:  "One  of  the  most  accurate  indices  of  a  teacher's  efficiency  is 
the  character  of  the  papers  and  of  the  black-board  work  that  his 
pupils  produce."*  The  same  author  also  says  that :  "Neat  papers 
and  neat  blackboard  work  involve  a  number  of  little,  specific 
habits,  and  each  of  these  must  be  taken  up  and  drilled  upon  apart 
from  the  others,  and  in  some  measure,  apart  from  the  content  or 
thought  of  the  work  that  is  being  expressed." 

Some  teachers  are  apt  to  be  concerned  entirely  with  the  ac- 
curacy of  number  papers  and  to  neglect  their  appearance,  pro- 
vided the  work  is  correct.  Superintendents,  principals,  and,  for 
that  matter,  teachers  themselves  have  only  a  limited  amount  of 
time  to  devote  to.  this  detail.  However,  it  is  an  important  one 
and  it  must  receive  enough  attention  to  obtain  good  results. 
Many  teachers  require  neat  papers,  but  in  any  large  system  of 
schools  there  are  always  some  who  in  this  respect  as  well  as  in 
others  need  considerable  supervision.  To  remedy  this  fault  as  far 
as  possible  and  with  least  outlay  of  time  and  effort,  the  chart  which 
is  here  described  was  devised  for  rating  the  general  appearance  of, 
number  work. 

This  particular  chart  is  not  offered  as  something  scientifically 
accurate — it  was  not  constructed  in  the  shade  of  a  great  univer- 
sity, nor  is  it  the  result  of  work  with  thousands  of  pupils,  hundreds 
of  assistants,  and  some  professors.  Nevertheless,  it  has  proved 
to  be  practical,  because  it  gets  results;  and  it  is  offered  as  a  sug- 
gestion to  other  busy  school  officers.  If  some  such  device  as  this 
is  occasionally  in  evidence,  work  of  the  type  shown  in  specimens 
1,  2,  and  3  will  be  very  rare. 

For  the  benefit  of  those  whp  wish  to  construct  a  general  ap- 
pearance chart,  it  is  suggested  that  they  gather  up  the  number 
papers  of  from  five  hundred  to  one  thousand  pupils  in  grades  i  to  v. 

^  Bagley,  W.  C.  Classroom  management;  its  principles  and  technique.  New  York: 
Macmillan  Company,  1916. 
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Figure  1 


This  should  be  done  without  previous  warning  to  pupils  or 
teachers.  From  these  papers  one  will  find  an  abundance  of  mate- 
rial with  which  to  construct  a  chart.  The  papers  should  be  care- 
fully divided  into  fourteen  or  fifteen  groups,  according  to  excel- 
lence of  appearance.  One  sample  should  then  be  selected  from/ 
each  group  and  cut  down  to  a  size  convenient  to  use  on  a  chart. 
The  samples  should  then  be  fastened  temporarily  with  paper  clips 
to  separate  pieces  of  cardboard.  Each  specimen,  when  thus 
mounted,  should  be  identified  by  a  letter.  In  Figure  1,  for  ex- 
ample, the  specimen  is  marked  F.  One  may  now  rearrange  the 
various  specimens  in  what  is  judged  to  be  the  correct  order,  from 
the  poorest  to  the  best.  It  is  desirable  to  have  the  judgment  of 
several  teachers  in  regard  to  arrangement,  first,  because  many 
opinions  are  better  than  one  and  second,  because  it  is  wholesome 
for  the  teachers  to  have  a  hand  in  such  matters. 
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A  good  way  to  secure  the  judgments  of  teachers  is  to  hecto- 
graph copies  of  Figure  2,  giving  one  copy  to  each  teacher  with  in- 
structions to  record  the  arrangement  of  the  samples  which  she 
thinks  is  best.  She  can  do  this  by  writing  the  identification  letters 
in  the  blank  spaces,  thus  producing  a  result  like  that  shown  in 
Figure  3.  One  may  then  figure  out  the  correct  order  in  which  the 
specimens  should  be  placed  on  the  final  ch-art.  When  this  is  done, 
one  has  something  that  is  as  useful  as  the  "Graphometer"  eye-test 
cards  or  any  other  chart  commonly  used  in  school  work. 

Figure  4  shows  the  ratings  of  128  papers  according  to  the 
"Chart  for  Rating  the  General  Appearance  of  Primary  Number 
Work."  The  pupils  were  distributed  from  the  first  to  the  fifth 
grade.  This  graph  vividly  shows  the  great  range  in  quality  of  the 
papers,  judged  only  from  appearance.  The  distribution  is  nearly 
as  great  as  are  typical  distributions  for  accuracy.  For  example, 
Figure  5  shows  a  distribution  according  to  accuracy.  The  mate- 
rial is  obtained  from  the  use  of  Courtis  Standard  Tests  in  Arith- 
metic, Series  B,  Addition. 

The  irregular  line  on  Figure  4  shows  the  median  scores  in  gen- 
eral appearance  for  the  various  grades.  Grades  i,  in,  and  iv  are 
probably  about  normal.  Collection  was  made  in  the  second  grade 
on  a  day  when  the  teacher  had  tried  to  secure  extra  good  papers. 
In  the  case  of  grade  v,  the  work  is  decidedly  uneven.  There  is  an 
apparent  lack  of  responsibility  on  the  part  of  the  teacher  and 
pupils  for  the  general  appearance  of  the  written  work.  No 
amount  of  explaining  by  the  teacher  that  this  was  an  unusual  day 
is  sufficient  excuse  for  this  slovenly  work. 

Figure  6  is  a  diagram  of  the  actual  relation  of  general  appear- 
ance to  accuracy  in  a  set  of  fifth -grade  papers.  The  figures  at  the 
bottom  denote  the  eight  different  percentage  ratings  assigned  to 
the  papers  by  the  teacher.  The  papers  were  marked  on  accuracy 
alone  and  the  examples  were  either  right  or  wrong.  Effort  did 
not  count.  It  will  be  noticed  that  many  of  the  best  papers  have 
a  very  low  rating  for  general  appearance. 

The  data  here  presented  are  not  sufficient  to  warrant  us  in 
drawing  definite  conclusions.  They  do,  however,  point  out  the 
fact  that  the  general  appearance  of  primary  number  work  is  not 
necessarily  closely  correlated  to  accuracy.  In  many  cases  habits 
of  neatness  must  be  developed  aside  from  those  of  accuracy.     It 
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may  be  that  the  higher  pupils  go  in  the  grades  the  greater  the 
correlation  between  neatness  and  accuracy.  In  the  eighth  grade 
it  may  be  very  high,  but  no  close  relationship  exists  in  the  case  of 
the  pupils  we  have  considered. 
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FIGURE  6.    RELATION  OF  APPEARANCE  TO  ACCURACY  IN  FIFTH- 
GRADE  PAPERS 


METHODS  OF  INTERPRETING  RESULTS  IN  THE 
CLEVELAND  ARITHMETIC  TESTS 

Joseph  Peterson 
George  Peabody  College  for  Teachers,  Nashville,  Tennessee 

In  a  number  of  respects  the  Cleveland  Survey  Arithmetic 
Tests  are  the  best  we  have  for  determining  by  group  methods 
the  relative  strengths  and  weaknesses  of  a  class,  a  school,  or  a 
school  system  in  fundamental  operations.  These  tests,  however, 
are  fifteen  in  number,  and  when  one  comes  to  the  practical  ne- 
cessity of  organizing  the  results  for  the  several  grades  of  the  dif- 
ferent schools  of  a  system,  one  becomes  painfully  aware  of  the 
need  of  some  weighting  scheme  for  the  condensation  of  the  data. 
Only  by  such  condensation  can  a  report  show  to  the  average 
citizen,  who  votes  school  funds,  and  to  the  educational  people 
who  use  them,  just  what  each  should  know  about  the  schools. 
Several  survey  reports  of  large  systems  tested  with  the  Cleveland 
tests  have  appeared,  and  all  seem  clearly  to  reveal  this  need. 
Many  tables  and  figures  are  found  in  these  reports,  but  in  no  case 
does  a  final  summarizing  graph  show  just  the  status  of  a  system 
in  all  the  fundamental  operations  together. 

An  attempt  was  made  to  present  such  a  showing  after  the 
Cleveland  Survey  Tests  had  been  given  to  the  children  in  the  B 
grades  of  the  Peabody  demonstration  school.^  The  median 
scores  in  each  of  the  fifteen  tests  as  obtained  at  Cleveland''  and 
Grand  Rapids'  were  accepted  as  norms,  and  the  corresponding 
medians  for  the  demonstration  school  were  expressed  as  percents 
of  these  norms.  Thus  a  percent  of  more  than  100  indicated  that 
for  the  grade  and  test  in  question  the  result  at  the  demonstration 
school  was  better  than  the  norm,  while  a  percent  of  less  than  100 
indicated  the  opposite.  Table  I  shows  these  percents,  those  less 
than  100  being  in  heavy  type. 

*  In  this  school,  which  is  connected  with  the  George  Peabody  College  for  Teachers, 
•ducational  surveys — and  usually  mental  surveys  also — are  made  annually. 

*  Judd,  Charles  H.  Measuring  the  work  of  the  public  schools.  Cleveland,  Ohio: 
The  Survey  Committee  of  the  Cleveland  Foundation,  1916.    290  pp. 

*  School  survey,  Grand  Rapids,  Michigan,  1916. 
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Table  I  shows  clearly  certain  weaknesses  which  would  probably 
not  have  been  pointed  out  for  correction  if  certain  tests  of  less 
diagnostic  value  had  been  employed.  For  instance,  it  is  evident 
that  in  the  demonstration  school  disproportionate  emphasis  has 
been  placed  on  the  simpler  aspects  of  addition — adding  a  few 
single-digit  numbers.  At  the  same  time  the  more  complex  proc- 
esses in  this  operation  have  been  neglected.  Pupils  have  not  been 
■  drilled  enough  in  retaining  the  accumulating  sums  of  long  columns 
and  in  the  process  of  carrying  to  other  columns.  Tested  by  the 
Courtis  tests,  the  school  would  doubtless  have  shown  a  general 
weakness  in  addition  which  the  teachers  would  have  tried  to 
correct  by  more  emphasis  on  the  very  thing  now  overdone,  accord- 
ing to  our  norms — namely,  quick  addition  of  short  columns  with- 
out carrying.  Similar  benefits  of  more  careful  analysis  than  is 
usual  are  also  evident  in  some  of  the  other  operations,  particu- 
larly in  multiplication  and  in  division.  The  more  complex 
processes  in  these  operations  need  more  drill. 

But  this  method  of  showing  results  is  capable  of  improvement. 
Absolute  scores  are  often  of  little  significance  unless  norms  are 
shown  not  only  for  the  grade  tested  but  also  for  the  grades  above 
and  below  it.  Such  norms  are  unobtainable  in  cases  of  tests — as  the 
Monroe  Standardized  Reasoning  Tests  and  the  Monroe  Stan- 
dardized Tests  in  Silent  Reading — that  are  different  for  upper  and 
lower  grades.  The  justification  for  the  use  of  such  tests  is  the 
practical  difficulty  of  getting  tests  with  enough  progressively 
harder  steps  of  equal  size  to  discriminate  sufficiently  well  between 
the  abilities  of  any  two  consecutive  grades,  from  the  lowest  to  the 
highest — a  difficulty  clearly  shown  for  example,  in  the  Trabue 
Language  Scale.  Upper  and  lower  norms,  as  well  as  norms  of  the 
grade  tested,  shown  either  in  tables  or  graphs,  or  both,  add  con- 
siderably to  the  interpretative  value  of  reports,  both  for  individual 
and  for  group  diagnosis;  and  it  is  not  difficult  to  show  such  norms 
when  all  grades  take  the  same  test. 

It  is  also  desirable,  if  possible,  to  interpret  the  deviation  from 
norms  or  standards  in  terms  of  years  of  progress.  As  our  schools 
are  organized  a  year's  work  is  a  natural  unit  of  measure,  and  even 
the  better  trained  educators — to  say  nothing  of  parents  and  the 
general  citizen  who  are  always  to  be  kept  in  mind — think  of 
retardation  or  acceleration  in  terms  of  years  (or  grades).    This 
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unit,  moreover,  is  the  one  most  successfully  used  in  the  conven- 
tional tables  and  reports.  Though  progress  from  grade  to  grade 
is  not  always  the  same  in  absolute  amount,  it  is  the  same  in  the 
practical  sense  that  it  always  takes  the  same  time  to  secure  it. 

Finally,  it  is  obviously  desirable  for  facilitating  a  general  rating 
of  a  grade,  or  school,  or  system  to  bring  together  somehow  the 
results  of  the  several  tests  into  a  single  table,  or  graph.  The  citi- 
zen who  votes  the  support  of  the  schools  is  particularly  interested 
in  this  final,  simple  form  of  the  results,  while  the  experts  only — 
the  teachers,  supervisors,  and  administrators — who  should  have 
the  time  to  study  details  relative  to  their  respective  duties,  are 
interested  in  the  smaller  diagnostic  features  of  the  report. 

Recently  the  writer  found  himself  confronted  with  the  neces- 
sity of  devising  a  satisfactory  method  of  condensing  reports  on  the 
Cleveland  Survey  Arithmetic  Tests,  or  of  adopting  tests  inferior 
for  the  purpose  in  view.  The  usual  situation  was  complicated  by 
the  fact  that  a  large  proportion  of  the  children  to  be  tested  were 
negroes,  whose  status  was  to  be  separately  shown.  The  school 
system  to  be  surveyed  was  that  of  Paducah,  Kentucky,  where  at 
the  time  of  the  survey  3,303  pupils  were  in  attendance.  Limited 
funds  compelled  us  to  make  the  report  on  educational  measure- 
ments comparatively  short. 

To  meet  these  practical  demands  of  limited  space  and  yet  to 
present  numerically  all  the  medians  (absolute  scores)  in  relation 
to  norms  of  various  grades,  we  decided  to  use  the  form  shown  in 
Table  II.  This  form  of  report  could  be  used  to  show  conditions  by 
buildings  as  well  as  for  the  system  as  a  whole. 

In  the  present  paper,  however,  we  have  omitted  the  scores  of 
the  several  schools,  and  have  shown  only  the  medians  of  all  the 
scores  of  whites  and  of  negroes  of  each  grade.  In  a  small  system 
it  is  possible  also  to  include  in  the  general  table  the  medians  of  the 
several  schools,  as  is  illustrated  in  Table  III  for  grade  iva;  but 
in  most  surveys  a  table  of  this  sort  would  become  so  bulky  as  to 
prevent  a  careful  study  of  the  more  generally  significant  aspects 
of  the  data.  In  such  cases  each  yearly  grade  could  probably  be 
shown  in  a  separate  table  similar  to  Table  III.  Even  then,  how- 
ever, a  general  summary  such  as  that  shown  in  Table  II,  would 
also  be  advisable,  both  to  bring  the  whole  situation  within  easy 
grasp  and  also  to  facilitate  the  construction  and  comprehension 


April  1921 


RESULTS  IN  ARITHMETIC]|TESTS 


283 


8§S§ 

r^  r^ 

1/5   (M 

ir 

fC 

rr 

es 

OS 

^ 

t^  t^ 

VO   C^ 

so  00 

NO     '- 

r^ 

*«  tn 

Ov   O 

■f   t^ 

00 

O 

tC   M 

•^  l« 

SO  \n 

f 

Ov   © 

o  <-< 

On    1-H 

t>- 

iz; 

fC   U5 

l«  l« 

U5   OS 

in 

VO  o 

r>-  t^ 

«<5   t^ 

fs)    © 

© 

■^ 

^ 

so  vo 

so   SO 

\n  -^r 

TT  in 

TT 

m 

t^    .-H 

-*  o 

fSJ    »H 

©  m 

00 

S 

>A 

r^  \o 

OS  r^ 

!>•   >0 

TT    -^ 

in 

•^  ra 

OS  in 

l-H     >r-< 

OS   h- 

in 

in 

M 

VO   00 

t^  t^ 

n   SO 

t^ 

so 

o  o 

n  1/5 

tfi   fO 

©   00 

1-H 

m 

t— » 

^-  t^ 

00  r^ 

r^  r^ 

in  in 

f<5 

so 

VO   QO 

\n  OS 

n  fc 

tn  ^ 

© 

r^  00 

t^  t>- 

«C   tT 

i-H  r^ 

so 

«i„ 

I— 1 

e 
^ 

es  i-H 

Os   «C 

so   fsj 

©     • 

© 

w 

W   to 

tn  tfi 

vo 

so 

1-H    O 

£S^ 

w  in 

r^  OS 

■^    ro 

■«9- 

o 

ON    OS 

t^  t^ 

t^  00 

SO     -H 

00 

00    00 

<0    fs) 

t^  o 

in  tn 

1—1     1--. 

NO 

fe 

o  o 

OS   00 

so    t>. 

t^   00 

so  o 

QO 

y-t   »-l 

1-H 

rO   t-- 

■^  OS 

-^  © 

^  i^ 

SO   rr> 

r^ 

w 

O   O 

tn  \c 

■<«■  in 

se  t^ 

in  t- 

NO 

<-l    ^-H 

00    00 

^     Tj< 

00   -^J- 

m  3 

©   oo 

NO 

Q 

OS   O 

o    »^ 

r^   On 

^  c 

o 

•<-l     »H 

On   1^ 

Tt<     •* 

<sj    t^ 

■^  -^ 

s§§ 

cs 

O 

CS    CN 

t^   t^ 

00   00 

O 

'"'     ■'"' 

1-H 

■*    00    00 

in  ^o 

in  i-H 

Tf   00 

■f   o 

<NO 

fq 

ro    '-H 

OS  OS 

00     -H 

00   OS 

00    (M 

o 

tH    ^-h 

T-l 

1-H 

1-H 
1 

CO   IT) 

^H    CN 

©  in 

so    NO 

in  "0 

PD 

< 

■^   O 

o  o 

OS   00 

OS   O 

On    C- 

O 

^-(   ^— 1 

y-l 

1-H 

a 

en 

tn 

1/1 

tn 

tn 

'S 

"2 

'2 

"2 

T 

'B  >> 

•  i-H 

'B. 

"Sh 

'a, 

'a, 

P 

^ 

5^  •  - 

13    t1 

T3     rt 

13     t^ 

T3     rt 

T3     c^ 

i" 

§^ 

§^ 

§2 

fl  Pi 

^S 

11 
o  2 

'^1 

0)  2 

11 

'^1 

-2 

o 

o  O 

U  O 

u  o 

u  o 

CJ  O 

m 

t4H 

o  ^ 

52;  dh 

•<* 

cs 

y-i 

CN 

cs 

ro 

<r> 

ro 

CN 

CO 

—  ■      ^ 

bC 

2 

w 

> 

v 

TJ 

e 

n 

•< 

ni 

t-« 

BQ 

m 

1 

3 

^ 

> 

> 

^ 

> 

3   V.2  bo 

a  c  >  ti  c 
•2  «*.§■§ 

•>c|.e-S 

<U  S  m  E  C 

sS-^iJ  o 
.g  c  £ 

Q  lis 

.Pas 

.ti  u  Y  C  vh 
60-3,  J>       u 

*:,  60  o  O 

c)  o     .  I,  > 
0  J3I-H    O  £ 

^  S I  c  0 
.2  g  0.2 

2  3  >•« 

o  St3  bo  bo 
■5  ">  C  c  c 

rt    •«  rt  o  ^ 


c  c 


^  ^  1) 


^■=•2-2.^" 


O  o  n       ti 

■si  2  "3 

rj--   C  60 

S        o  c;- 


60 


-  bca  i2  3 

is  5:1^" 
■bo«  E  g« 

C  3  <£  o;3-;3 
.2  o  g  «?  2 
.■s  "  -S  c  «  u 

01. S  .  o  ..  2 
.       W  1)  1,**-' 

<^  -M^  j; 

D   C   C'S 

"  o  °  2  uT 
-^  o  0^0 

°     g-2^  2 

Cr  ^  --•  QNW 
qW    >>'0    > 

«  M  tn  "•  O" 
C  t.  t:  -  >>  E 
rt  <U  3)1— >X!.S 

«  ^  o^"?  •- 

bo       5  3  4J 

^^N*-!  3  o  !>• 


284 


JOURNAL  EDUCATIONAL  RESEARCH 


Vol.  3,  No.  4 


W 
< 

Q 
< 

H 
< 
m 
\A 
Pi 
O 
O 

< 

M 

Q 


cs  lo 

va  >o 

OS 

■"t 

»-i   >r^ 

t^ 

so 

*o  *o 

o 

Oo 

Os 

o\ 

00 

•-<   VO 

1-1 

so  lO 

u 

'H   ts 

O  ^h 

1-1 

es 

so   (r, 

iH 

o 

«o  ■<». 

1-1 

■^ 

fo 

o 

o 

"^    CO 

1^ 

to   to 

12^ 

■<*<  t^ 

tVj.t^ 

"* 

OS 

so   O 

■* 

t~. 

C   Oo 

00 

o 

tv 

00 

t^ 

Oo    ^ 

00 

X5    »-, 

^  o 

CM    fvj 

1-1 

o 

CM   CM 

■^ 

o 

CM    »-< 

o 

CM 

♦-< 

o 

o 

'"1  *~1 

O 

•~H     »-< 

s 

O    '-^ 

<*>  t^ 

CO 

»o 

fsa  t^ 

Os 

so 

■as  O 

t^ 

V-, 

Ov 

CO 

es 

■>*  w^ 

00 

CM    tr> 

'tt*  to 

w,  x/^ 

to 

■* 

>^  1^ 

«N 

fS 

rj.  w^ 

es 

•<^ 

•^ 

CO 

es 

"*  ■<*• 

es 

"*     'SJ- 

«0   CO 

f»^   0\ 

00 

CO 

<M    «5s 

1-1 

CO 

t^  w-^ 

o 

X5 

«o 

Os 

so 

•~(    V3 

so 

tO    to 

1-4 

fC    CN 

»^   rt- 

es 

es 

«^   -^ 

CO 

■^ 

•<S-   Xh 

es 

■^a- 

■* 

■^ 

'-' 

\f    CO 

'-I 

\1-    tr^ 

"*  a\ 

ts.      "^ 

o 

t^ 

CO   t^ 

00 

l-( 

t^    Oo 

so 

fo 

w-^ 

00 

00 

TJ.    u-> 

o 

Os   M- 

\4 

r~   ro 

-1  -^ 

so 

t^ 

^^ 

so 

CO 

Os   Oo 

■* 

00 

t^ 

CO 

CO 

t^  vs 

CO 

so   «^ 

^   OS 

Oo    «i-> 

•* 

ir> 

"<S-   l^ 

IT) 

SO 

fo  fo 

CO 

fvj 

•«^ 

es 

Os 

~S    W-i 

C> 

O    ~^ 

1— » 

Tj«     CS 

«<-,    XS 

CO 

CO 

W^    lO 

CO 

es 

W-,    U-, 

CO 

»i-l 

W-) 

CO 

es 

vn  ■(^ 

CO 

U-,  rj- 

»-l    vO 

Oo  t^ 

■* 

to 

rh   O 

^ 

00 

O    ^ 

SO 

lo 

Oo 

CO 

CO 

"-H     O 

00 

Ov    tr. 

t— 1 

Tjt    ,-t 

>^  "* 

cs 

■^ 

«o  •^ 

CS 

o 

X-,   •'^ 

'-' 

■^ 

fO 

1-1 

-^ 

"^     Cl^ 

o 

to    tM 

w 

•^    O 

O   Oo 

t^ 

cs 

Oo    so 

o 

■* 

tS.    Oo 

o 

W-) 

O 

CO 

■* 

»<    W-, 

es 

C>    «M 

^ 

tS     «-! 

<V)    Oo 

CO 

00 

O    Oo 

CO 

lO 

Os    In. 

■* 

Os 

Os 

•* 

es 

Oo   >0 

CO 

Oo   xs 

O    CN 

Oo    Oo 

o 

CO 

■<1-  t>» 

Os 

es 

Os    -s 

CO 

•^ 

»-i 

,1 

1-1 

CM    ^ 

00 

Os  fn 

o 

lO   fO 

t^  vs 

lo 

CO 

t^  <s 

■* 

'i* 

VS   Vi 

■* 

X5 

vs 

■* 

■* 

so    W-, 

CO 

w-i   lo 

On    fO 

f^  o 

t-« 

«o 

1^    crj 

'i* 

t^ 

so    NO 

t~« 

>^ 

fO 

1-1 

m 

to  c 

1-1 

c  -^ 

Uh 

t^   t^ 

so 

00 

'~1  ~1 

so 

■* 

Os    Os 

<=o 

Oo 

Os 

in 

m 

Oo    Oo 

■* 

Oo    l>* 

Os   00 

•<»•  -^ 

CO 

es 

O  Oo 

O 

1-1 

"*  tv> 

00 

vs 

CM 

1-1 

t^ 

*-1  o 

m 

Os   O 

w 

Tj.     Tj. 

Oo    Oo 

lO 

so 

Oo    tN. 

lO 

■* 

t^   t^ 

■* 

v^ 

t^ 

in 

■<J< 

tN.    so 

•* 

so    >0 

00  m 

t^  o 

CO 

tn 

Oo  >o 

t^ 

m 

CO   t^ 

CO 

to 

■* 

t^ 

CO 

lo    Os 

CO 

to  lo 

w 

00   t1< 

v~,   rr^ 

SO 

so 

CO    O 

r— 

,_, 

CM    Os 

in 

■~H 

Oo 

r-i 

■* 

O    XS 

<N 

Ov    lo 

«-l   1-1 

CM    CM 

CM   «vj 

"^ 

'"' 

CM    *^ 

^ 

tM 

•-^ 

■^ 

1-1 

CM   ~i 

1-1 

*-^  »-l 

00    t-~ 

Ov   t^ 

00 

m 

t^   ^ 

r^ 

lO 

Oo    Oo 

t^ 

Os 

tN. 

CO 

m 

to  c> 

o 

CM    lo 

u 

-O    lO 

~^  o 

lO 

CO 

C5    GK 

>o 

■* 

Os    Oo 

CO 

Oo 

N, 

CO 

so 

Oo  t-^ 

to 

Oo  lo 

CM   <M 

CM    ~i 

^ 

*-<  '^ 

1-1 

*~l 

■--i 

'"' 

T-l 

•-I   ~^ 

rH 

i^i    *-l 

^  00 

rrj   u-^ 

so 

CO 

ts.    Oo 

in 

t^ 

CM  t^ 

t~» 

Oo 

•O 

t^ 

CO 

^   »-i 

o\ 

to   Oo 

m 

Ov    t^ 

Oo    W-, 

00 

1-1 

so    CM 

t^ 

CO 

rh  C) 

r^ 

<M 

>~i 

m 

SO 

O,    Ov 

Tf 

?■  *<=> 

«-l   1-1 

CM   CM 

■^ 

es 

CM    CM 

1-1 

""^ 

CM   CM 

1-1 

evi 

es 

""* 

1-1 

CS)     '~H 

1-1 

CM   *^ 

lo  cs 

CM  en 

1-1 

00 

crj    l,^ 

CO 

m 

■*  fo 

•* 

Oo 

K-l 

00 

CO 

•^  c> 

00 

to   Oo 

<: 

CS    •'I* 

CM   O 

r~ 

o 

CM    "Ss 

Tt< 

CO 

Oo    tN. 

,_, 

1^ 

v?> 

ON 

00 

so    »i1 

so 

so    CM 

«N  es 

t^   c^ 

CM 

es 

fO   «M 

es 

CS 

CM   M 

es 

«M 

CM 

1-1 

1-1 

CM    CM 

1-1 

CM   csg 

<*H    tn 

O  rt 

<o 

1-1 

Os 

b^ 

so 

CO 

to 

'^ 

<o 

I-. 

o\ 

<o 

O 

«o 

d 

in  cN 

4 

00 

en 

•|l 

Os 

es 

:2 

•it 

o 
1-1 

.iO 

0:^ 

Os 

CO 
tn 

4 

ON 

■i« 

2 

^1 

^1 

v5  c5 

1 

CO 

1 

4| 

1 

51 

o 

< 

s 

< 

s 

i 

i 

^ 

^ 

^ 

AprU  1921 


RESULTS  IN  ARITHMETIC  TESTS 


285 


1/5    \0 

«s-> 

NO           • 

<^    • 

VO     NO 

to      • 

to  to 

o 

•^    O 

r^       . 

0      ; 

r^ 

0  0 

CVJ        . 

0  0 

»^  r^ 

rn   oo 

to     NO 

<^  N. 

to  to 

»-( 

•   VO 

00 

:< 

O   O 

'^   O 

0     0 

"^   0 

0   0 

*-H 

:  ® 

C>      • 

;^ 

f^    CO 

i^  v^ 

00  to 

•^   <2> 

m  -"j^ 

rn  en 

On   00 

On 

NO    \0 

»^ 

• 

to 

cs  ^ 

f^    r^ 

»-(  ^-1 

f»5    f^ 

»-<      T-( 

^  M 

0   0 

«M      ; 

0  0 

CV3 

• 

C>      ; 

\r>  es 

'J-    On 

On   t~ 

*^    CO 

00    NO 

On 

VO  l^ 

to      • 

NO   to 

hj 

•r-l    »H 

fn  <M 

0    0 

en  <M 

0  0 

CM 

0    0 

CM 

0  0 

■*    t^ 

OO    05 

00   -H 

0  <=> 

0    On 

0 

•  t^ 

en 

:| 

t^ 

«N    CS 

»r^   •"^ 

0     -H 

to  t^ 

-H    0 

■^    : 

;  0 

rn      . 

00  o- 

<*5   ts. 

to  to 

-^  ■<a- 

m  0 

On   Oo     to   On 

Oo        • 

t—  t^      On       • 

to   \0      VO       • 

1— , 

es)    y-< 

■•a-  ^ 

CS    CN 

-y-     Cr, 

CS   ro 

en  CM    ^  0 

'^    : 

0  C 

CM       • 

0   0      '-^       ; 

t^  t^ 

M   ^ 

to   to 

0  cn 

NO   to 

<=>   Ov 

NO  to 

0  t^ 

.  'sh   ; 

•      »-<      • 

M 

o  o 

C«r>    .«, 

0  0 

fy^   *^ 

0  0 

CM    0 

0   0 

CM   0 

•  »-i 

•      •-< 

fo  a> 

U-,    P^ 

00  >o 

Oo       '• 

00   NO 

Oo 

0  0 

Oo 

to  i-»     Oo     • 

00  >o     t^     • 

hn 

w 

■*    CS 

\o  \s 

0  '-I 

"*       ■ 

^  cs 

<)    • 

cs  »-t 

t^,    • 

0   0      er>       . 

0  0    c>     • 

eS 

. 

. 

.    1 

ts  en 

vs  <^ 

■<1<    On 

to  «o 

■*  ■^ 

»-i   er, 

Tj<    rt< 

On   cm 

NO    CM      to 

l^     NO         t^          • 

o 

fC  c^ 

«^  M- 

es  ^ 

to  ^ 

CS     fSl 

to   en 

y-t    »H 

■<»•   CM 

»-i   t-H      ei^ 

0   0      CM      ; 

t~    IT) 

•^  to 

0   CO 

^  C> 

NO     •^ 

<2)   '-^ 

0    0 

NO    Oo 

On   00      to       • 

NO   \0      ef>       : 

tM 

Ti<     Tj< 

t>^  vs 

es  es 

NO  vs 

<o  to 

NO     <* 

»H    CM 

to    C\) 

0   0      e^       ; 

0   0       CM       ; 

00    <3 

>-H     •<y- 

re   <N 

<S   «M 

t^  0 

rj-   >o 

00   CO 

t^  »-1 

On   »-t      Oo       . 

to  NO     Oo      • 

w 

t1<  (T) 

VO   tr, 

<o  ■* 

NO     ti-) 

CO     TjH 

to  \h 

c^  cs 

to  'y- 

es  c^^     '^      • 

CS   ^      e»5       . 

es  to 

Oo   r^ 

00   OS 

rh  t/-, 

»-i   CO 

en  •«»• 

to  to 

Oo    On 

^   00      CM       • 

NO  t^      0       ; 

Q 

to  ■>-* 

Oo    CM 

t^     NO 

V3   C> 

en  CO 

to   ^0 

<^   <S       CM       • 

'H   0      Ov       • 

^   vo 

t^   0 

■*   to 

On   t^ 

00  10 

rh   e^ 

0  0 

t>*    -1 

0   On      »0       • 

»H   rjt      NO       ■ 

u 

0\   ro 

00  t^ 

NO   en 

t^  t^ 

^:; 

to  ^ 

>0   N. 

00  en     0      • 

es   •-•      tN. 

•rH    0» 

C>   On 

0  to 

0  t>^ 

cs  t^ 

<=.     -H 

eo   0 

»~(    *>< 

00  00    CM  '<!^ 

Ov   'I      On   en 

n 

<2>  ti-) 
CM    ~-i 

00   00 

Oo    Sh 

0  0 

N.   fM 

to  «o 

t^   On 

t^  ■^     CM  Oo 

•<i<   e«»      Ov   NO 

00    On 

to  ti-i 

00  00 

to    en 

t^     »H 

en  ■* 

On   0 

Oo  NO 

■>*   to      e»)  ^ 

On  to      NO  Oo 

<J 

CM    CNCI 

<0   ro 

CM  'i; 

(N   en 

0>    erj 

^10      Oo  e») 

1-1             »-i   •^ 

00     t^         '^     '-H 

■    dt 
O     3 

12;  PM 

1 

1 

1 

lo  m 

tn 

^55 

1^ 

II 

1'^ 

tS   NO 

0   CO 

■t->     H 

CO  C5 

55  c3 

Whites        101 
Negroes        39 

5^  Louis 
Grand  RaPids 

Whites        105 
Negroes        31 

5/.  Louis 
Grand  Rapids 

^ 

^ 

< 

I 

I 

I 

M 

286 


JOURNAL  EDUCATIONAL  RESEARCH 


Vol.  3,  No.  4 


c/3    Ph 


r  1     ^ 


W 

w 

H 

M 


p 

< 

w 
> 

!^  d 

H 

<! 

H 
P 


\o 

tn  NO 

t^ 

NO 

t^ 

»o 

lo 

o 

o  o  o 

o 

o  o  o 

CM 

lo  i/^  vo  »o  tn  \o 

\n  NO 

«-l 

14 

o  o  o  o  o  o 

O   O       ; 

»H 

fO   'O   CM    fO    Ov    fO 

Tit    On    CS 

r<^   ro 

1^ 

»-l     »H     i-H     ^-H     O     (S 

^-4     '-I     ^-1 

fT)    CS 

00    00   O   00   t^    00 

NO     t^     NO 

On 

ij 

o  o  •>-<  o  o  o 

o  o  o 

CM 

o  -^  O  t~  ^  o 

On    no 

o 

ti!| 

^  »-i  es  o  '-•  ^ 

o  •^ 

■* 

ro   '1'    fD   •*   NO   O 

O   00  t- 

On    00 

t— » 

tS    «N    CS    »-l    -H    CS 

fo  fo  »-l 

ro  es 

vO   m  t~   ^ 

o 

lO 

>o 

O    On 

fS 

»— 1 

o  o  o  o 

1-H 

o 

o 

CS   O 

00   Tj<  t^  t^  o  t- 

\0    CN    "0 

00 

^ 

^ 

w 

^    "*    f>    O    fC    cs 

ts   CN    ro 

NO 

t1<  00  00  t^  >o  00 

tH    (T)   l^ 

•-I  fc 

o 

(S    CS    ^    '-I    «S    CN 

CM  es  ^ 

to   CO 

\o  •*  «o  "^  <^  o 

'-I   ro   »H 

O   '-I 

fa 

rD    -^    f<0   es    fO    "1 

lO   lO   >o 

NO     Tl^ 

t^   NO   ro  t^  vO   O 

O    «M    On 

•*     NO 

w 

ro   ro   rC  ^   fC   f^ 

rjt   irj   «M 

»o  >* 

•p-t  00  o  «o  O  C 

<r>  fo  fo 

CO   "<* 

p 

X^    t^    On    fO    «0    <^ 

NO  t-  ■* 

vo   O 

00  fo  t^  O  cs  i/- 

lO    On   lO 

■*    CO 

u 

»^   00   00   On   «   t^ 

t^   t^    rO 

P^00ro00>0          l^POiO 

o  ■^ 

PQ 

OOOOOt^lO           O^HOO 

t^    CM 

»H    »-l              tH              »-I              »H    »-t 

i^vOfOOt-i'i         ^-^irjNO 

CO   ■* 

< 

-W     NO 
CM     ■r^ 

o:^ 

OJ-*CSnOnOtJ<           NO^iD 

-;    Cu 

OesT-i«scs»-H         fees'-! 

^    3 

T-i 

Z  Oh 

en 

t3 

d 

'a, 

1 
^ 

y 

1 

c 

2 

MS 

.  Louis, 
rand  Ra 

a  p:  ^  £  s  ►: 

g  J  o 

§550 

^ 

Iz 

^ 

1 

AprU  1921  RESULTS  IN  ARITHMETIC  TESTS  287 

of  a  subsequent  table  in  which  retardation  or  acceleration  would 
be  shown  in  terms  of  the  grade  units  which  we  have  advised  above. 

Such  a  table  was  utilized  in  the  Paducah  survey.  It  is  here 
presented  as  Table  IV.  It  brings  out  emphatically  in  small  space 
the  median  retardation  of  each  grade,  and  records  negroes  and 
whites  separately. 

A  table  of  this  sort  can  be  constructed  in  a  comparatively  short 
time  by  an  intelligent  assistant.  The  method  of  doing  so  and  the 
significance  of  the  table  can  best  be  made  clear  by  a  few  concrete 
illustrations.  According  to  Table  II  the  score  of  the  white  children 
in  grade  viiiA  on  test  A  is  22 . 5.  This  is  below  either  of  the  stand- 
ards given  for  the  viiia  grade.  Glancing  down  the  same  column 
at  the  standards  of  lower  grades,  we  note  that  this  score  exactly 
equals  the  St.  Louis  standard  for  grade  va,  and  that  it  is  approxi- 
mately equal  to  the  Grand  Rapids  standard  for  grade  vib  (22.8). 
These  grades  are  therefore  put  down  in  Table  IV  under  test  A, 
opposite  grade  "viiiA,  Whites"  in  the  lines  for  St.  Louis  and 
Grand  Rapids,  respectively.  The  standing  of  the  negroes  is 
indicated  in  a  similar  manner.  Again,  in  test  B,  Paducah  grade 
VIIIA,  whites,  equals  approximately  St.  Louis  and  Grand  Rapids 
grades  VA  and  via,  respectively;  and  so  on.  The  nearest  half- 
grade  in  the  norms  is  always  chosen.  It  will  be  noted  that  in  the 
case  of  test  H,  Paducah  is  especially  low;  and  that  on  practically 
every  test  the  negroes  are  below  the  whites.  At  the  right  of  the 
table  we  indicate  in  terms  of  years  the  average  distance  that  the 
respective  Padacuh  grades  were  found  to  fall  short  of  the  norms 
considered.  This  rating  is  based  on  the  assumption  that  the 
grades  indicated  under  each  test  are  correctly  entered.  But  only 
the  nearest  half-grade  is  given;  accordingly,  there  are  slight  errors, 
sometimes  in  one  way,  sometimes  in  the  other.  It  is  assumed, 
however,  that  these  errors  will  on  the  whole  cancel  one  another 
when  averaged  for  the  fifteen  different  tests,  since  the  chances  of 
error  in  the  two  directions  are  practically  equal. 

It  was,  of  course,  impossible  thus  to  rate  the  lower  grades, 
whose  scores  were  below  any  available  norms.  But  this  is  not 
important  as  deficiencies  in  the  lower  grades  are,  as  a  rule,  re- 
flected in  the  higher  grades  if  they  are  characteristic  of  the  whole 
system;  and  it  is  the  upper-grade  children  that  must  soon  come 
into  competition  with  children  from  other  systems.    A  deficiency 
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in  a  certain  subject  in  the  lower  grades  may  be  due,  in  fact,  to  a 
general  emphasis  on  other  lines  of  work  at  first,  and  may  be  regu- 
larly compensated  for  later. 

On  the  other  hand,  systems  in  which  the  scores  are  superior 
to  these  norms  used  cannot  be  accurately  rated  in  the  eighth  grade 
by  the  method  exhibited  in  Table  IV;  for  the  comparison  norms 
do  not  extend  above  this  grade.  But  this  is  not  a  serious  defect 
in  the  method,  for  emphasis  on  any  subject  may  safely  be  relaxed 
when  the  grade  norms  are  reached.  For  instance,  an  viiiA 
grade  exceeding  by  an  appreciable  amount  the  St.  Louis  median 
of  32.2  in  test  A  might  reasonably  be  excused  from  further  drill  on 
additional  work  of  this  sort;  and  since  there  is  no  "grade"  signifi- 
cance to  progress  beyond  this  standard,  it  is  sufficient  to  know 
merely  that  the  norm  has  been  surpassed.  In  a  school  system 
where  such  acceleration  exists  its  approximate  amount  can  be 
shown  by  noting  in  the  table  which  of  the  grades  below  viiiA 
first  reached  the  norm  of  this  grade. 

TABLE  V.     DEFICIENCY  OF  PADUCAH  SCHOOLS   IN   TERMS   OF   YEARS 
WHEN   COMPARED   WITH   STANDARDS   OF   ST.    LOUIS   AND 
GRAND  RAPIDS 


Grades 

St.  Louis 

Grand  Rapids 

Whites 
Years  behind 

Negroes 
Years  behind 

Whites 
Years  behind 

Negroes 
Years  behind 

vmA 

VIIIB 

VHA 

vnB 

3.17 
3.43 
2.80 
2.93 
2.60 
2.30 
1.87 
1.75 

4.23 
3.03 
3.60 

2.23 
2.03 
1.60 
1.70 
1.27 
1.07 
0.77 
1.33 

3.10 
2.03 
2.50 

VIA 
VIB 

2.37 

1.20 

VA 
VB 

1.97 
1.77 

0.77 
1.00 

Average 

2.61 

2.83 

1.50 

1.77 

Our  next  step  may  be  to  bring  together  the  general  results  of 
the  data  shown  in  Table  IV.  This  is  done  in  Table  V,  which 
shows  a  progressive  retardation  of  Paducah  children  with  in- 
creasingly higher  grades.    As  between  whites  and  negroes  the  dif- 
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FIGURE    1.       SHOWING    PROGRESSIVE    RETARDATION    OF    PADUCAH 

SCHOOL   CHILDREN   IN   ARITHMETIC   AS   DETERMINED    BY   THE 

CLEVELAND  TESTS.     RETARDATION  IS  GIVEN  IN  UNITS  OF 

A   year's    PROGRESS.       ST.    LOUIS    STANDARDS    USED 
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ferences  in  favor  of  the  former  are  greater  in  the  higher  grades. 
In  grades  v  and  vi  combined  the  two  races  are  on  practically 
equal  terms.  In  grades  vii  and  viii  combined  the  negroes  fall 
short  of  the  whites  by  0.49  of  a  year  according  to  the  St.  Louis 
standards  and  0.65  of  a  year  according  to  the  Grand  Rapids 
standards. 

Figure  1  shows  graphically  part  of  the  comparisons  given 
in  Table  V.  It  is  arranged  in  the  ascending  order  of  the  grades  to 
show  that  the  retardation  gradually  and  regularly  increases  with 
years  of  training  in  the  system. 

It  is  to  be  understood  that  Tables  IV  and  V,  and  Figure  1, 
are  constructed  on  the  assumption  that  the  tests  all  have  equal 
weight  in  determining  the  general  status  of  the  schools  in  arith- 
metic; that  is,  that  the  extent  of  retardation  in  each  grade  in 
terms  of  yearly  progress  may  be  found  simply  by  averaging  the 
deviations  from  the  norms  in  each  of  the  fifteen  different  tests. 
No  special  weighting  was  given  any  one  of  these  tests.  While 
some  of  them  are,  of  course,  harder  than  others — on  some  tests, 
indeed,  the  children  in  the  lower  grades  did  not  make  any  score  at 
all — it  has  been  thought  fair  to  find  grades  in  the  other  school  sys- 
tems, making  scores  equal  in  each  test  to  those  of  the  several 
grades  at  Paducah,  and  to  make  our  comparisons  on  this  basis.  It 
seems  fair,  in  other  words,  to  call  a  grade  in  one  school  system 
equal  to  a  lower  grade  in  another  if  the  two  grades  actually  do, 
under  uniform  conditions,  the  same  amount  and  quality  of  work. 
In  the  fundamentals  of  arithmetic,  we  may  then  conclude,  the 
schools  here  used  to  illustrate  our  methods  are  seriously  behind 
the  standards  of  representative  American  cities,  so  far  as  rapidity 
and  accuracy  in  the  fundamentals  are  concerned.  This  deficiency 
is  clearly  shown  to  be  general  throughout  all  the  schools  and 
grades.  In  grades  iii,  iv,  and  vb  the  extent  of  the  deficiency 
cannot  be  exactly  measured,  because  these  grades  fall  below  avail- 
able standards  in  some  of  the  tests  used.  The  general  status  of 
the  schools  is  clearly  indicated  in  Figure  1,  which  shows  that  the 
retardation  is  greatest  for  the  higher  grades  and  that  it  decreases 
as  we  go  down  the  grades.  This  is  as  we  should  expect,  if  the 
causes  of  the  deficiency  are  general  in  the  schools;  for  these  causes 
will  have  operated  more  years  in  the  higher  than  in  the  lower 
grades.    If  the  native  ability  of  the  children  in  this  system  is  on 
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the  average  comparable  to  that  of  the  children  in  the  cities  used 
for  comparison — and  for  this  assumption  we  have  supporting  evi- 
dence from  a  mental  test — the  difference  in  median  scores  should 
be  negligible  at  the  time  of  beginning  arithmetic  work  in  the 
schools.  For  simplicity,  Figure  1  represents  graphically  the  com- 
parison with  only  one  other  school  system,  but  it  is  evident  from 
Table  V  that  the  school  studied  is  seriously  behind  reasonable 
norms.* 

The  suggested  method  of  handling  the  data  of  the  fifteen  Cleve- 
land tests  shows  in  a  simple,  convincing  manner  the  general  status 
of  the  schools  as  regards  the  fundamentals  of  arithmetic;  and  it  is 
also  capable  of  showing  in  any  degree  of  detail  desired  by  pro- 
fessional educators  the  work  of  different  grades  and  schools  in 
any  phase  of  the  processes  emphasized  by  these  tests.  One  grade 
in  a  certain  school  may,  for  instance,  be  found  to  be  comparatively 
normal  in  the  very  simplest  forms  of  the  fundamental  processes, 
and  yet  seriously  deficient  on  such  phases  of  these  processes  as 
adding  long  columns,  subtraction  with  borrowing,  estimating  the 
probable  number  of  times  one  number  is  contained  in  another,  etc. 
It  is  certainly  important  in  surveys  that  just  such  diagnostic 
features  of  school  work  be  brought  out  in  a  way  available  for  the 
experts  who  are  to  correct  the  defects  shown  in  the  more  general 
graphs  for  the  non-technical  reader.  If  such  necessary  data  are 
furnished  in  the  report,  the  professional  educators  concerned  can 
work  out  for  their  special  purposes  and  needs  such  additional 
graphs  and  tables  as  they  desire. 

*  It  is  but  fair  to  add  here  that  the  Paducah  schools,  used  in  our  illustration,  were 
tested  at  a  time  when  the  disturbances  from  influenza  were  to  be  reckoned  with,  but 
there  is  no  satisfactory  evidence  that  the  status  of  the  schools  would  otherwise  have 
been  noticeably  different  from  that  shown  in  the  report.  The  general  spirit  of  the 
directors  of  the  schools  was,  fortunately,  such  as  to  remedy  the  defects  as  soon  as  pos- 
sible.   Important  steps  to  this  end  w«re  taken  as  a  result  of  the  survey. 


PRACTICAL  VERSUS  PURE  RESEARCH 

Pure  research  is  a  term  used  to  describe  the  investigation  of 
problems  whose  selection  is  based  primarily  on  the  individual 
interest  of  the  investigator  and  whose  solutions  need  have  no 
value  as  direct  influences  upon  human  conduct.  An  investigator 
in  the  field  of  pure  research  has  to  account  neither  for  the  source 
of  his  problem  nor  for  his  solution — except  that  the  solution  must 
be  arrived  at  in  accordance  with  the  rules  of  the  game  in  his 
particular  field.  His  justification  is  adequately  based  upon  the 
fact  that  the  human  mind  is  permitted  to  expend  its  energies 
upon  any  undertaking  which  is  conceived  and  carried  on  in  the 
spirit  of  pure  research.  That  the  results  obtained  may  later  be 
turned  to  use  by  other  agencies  in  influencing  conduct  does  not 
detract  from  the  spirit  of  such  research.  Many  of  the  principles 
of  electricity  which  are  now  used  in  the  operation  of  public  utili- 
ties and  domestic  flatirons  were  discovered  by  scientists  who  did 
not  foresee  their  practical  applications.  Or,  if  dimly  seeing,  they 
investigated  merely  for  the  love  of  discovery. 

Practical  research,  on  the  other  hand,  is  a  term  used  to  de- 
scribe the  investigation  of  problems  which  spring  from  the  difficul' 
ties  of  human  conduct  and  whose  solutions  are  evaluated  in  terms 
of  their  efficiency  in  improving  conduct.  The  beginning  and  the 
end  of  practical  research  reside  in  conduct.  It  begins  with  faulty 
practice  and  ends  with  the  improvement  of  practice.  Such 
problems  as  those  of  educational  measurements  rise  as  practical 
research  problems  out  of  the  practices  of  the  schoolroom  when 
teachers  are  unable  to  determine  in  objective  terms  the  ability 
of  their  pupils  and  the  effectiveness  of  their  methods,  or  when 
administrators  are  unable  to  judge  of  the  relative  efficiency  of 
their  teachers.  The  value  of  educational  measures  is  judged 
absolutely  by  their  effect  upon  school  practices  as  shown  in 
accurate  measures,  improved  methods,  and  exact  evaluation. 

293 


294  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  3,  No.  4 

Bureaus  of  educational  research  are  agencies  of  practical 
rather  than  of  pure  research.  The  members  of  their  staffs  are 
not  justified  in  selecting  any  problem  through  mere  individual 
preference.  The  problems  must  be  found  in  the  operations  of  the 
school,  and  the  solutions  are  neither  complete  nor  valid  until  they 
have  affected  school  practice  to  its  advantage. 

In  both  of  these  respects,  the  bureaus  are  frequently  at  fault. 
Their  problems  are  sometimes  chosen  without  regard  to  institu- 
tional importance  and  the  solutions  are  not  carried  to  such  lengths 
that  they  can  be  used  in  practice.  At  other  times,  and  much 
more  frequently,  their  problems  are  well  chosen  but  the  solutions 
are  not  perfected  with  the  degree  of  adaptation  necessary  for  use. 

For  instance,  during  the  last  five  years,  educational  tests  have 
been  widely  given  by  bureaus.  It  has  been  discovered  and  shown 
in  numberless  tables  that  some  children  attain  greater  efficiency 
than  others  and  that  some  classes  are  superior  to  others.  The 
amount  of  labor  involved  in  giving  and  tabulating  the  tests  has 
been  enormous  and  frequently  the  distress  of  the  teachers  has 
been  acute.  In  many  cases  the  morale  of  the  instructional  staff 
has  been  injured  and  the  reputation  of  the  bureaus  as  service 
agencies  has  been  ruined.  The  teachers  feel  the  true  facts  of 
the  case.  Such  bureaus  have  not  been  constructive  because  they 
have  not  improved  practice;  they  have  taken  only  the  first  step 
and  found  the  problem.  When  they  have  put  their  hands  to 
the  plow,  they  have  stopped  in  the  furrow  before  the  task  was 
complete.  Practice  is  no  better  than  before  except  in  so  far  as 
the  urge  of  fear  has  driven  the  teachers  to  improve  methods  whose 
inferiority  is  evidenced  by  the  poor  showing  of  their  students. 
The  bureau's  solution  is  not  complete  until  it  has  both  pointed 
out  the  weakness  of  the  methods  and  collected  new  methods  or 
disseminated  old  ones  and  has  seen  that  the  technic  of  using  them 
is  known.  When  practice  has  been  adequately  improved,  then 
and  not  until  then  is  the  research  bureau's  work  complete. 

Or,  to  take  a  very  simple  case,  a  child  is  sent  to  the  bureau 
for  mental  examination  because  his  work  is  not  satisfactory. 
The  tests  being  given,  an  unfavorable  report  may  be  made  to  the 
principal.  But  the  bureau's  task  is  not  complete  if  the  child  is 
returned  to  the  same  environment  and  nothing  is  done.  Practice 
has  not  been  improved.    There  yet  remains  the  question  of  what 
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to  do  with  the  case.  This  may  lead  to  a  long  campaign  for  special 
rooms  for  defectives,  or  to  the  quick  decision  to  place  this  defec- 
tive in  a  school  for  his  kind  or  to  put  him  in  a  class  more  nearly 
fitted  to  his  capacities.  But  in  any  case  the  urge  to  see  the  task 
carried  to  the  end  must  not  be  weak;  it  is  strong  enough  in  good 
bureaus  to  keep  pressure  applied  persistently  and  diplomatically 
until  something  is  done. 

This  means  that  the  members  of  the  staff  cannot  be  mere 
specialists  who  are  satisfied  with  reaching  an  abstract  solution. 
They  must  have  intimate  knowledge  of  the  workings  of  the  school 
system  so  that  their  recommendations  can  be  applied  without 
material  modifications.  For  in  the  event  of  failure  to  do  some- 
thing, the  administration  cannot  be  blamed  except  on  the  proven 
grounds  of  laziness.  The  bureau  will  be  wise  if  it  assumes  that 
the  fault  is  its  own  because  its  solutions  are  not  practical  and  as 
such  do  not  fit  into  the  educational  situation. 

So  important  is  the  difference  between  the  standpoint  of  pure 
and  practical  research  and  so  easy  is  the  acceptance  of  incomplete 
practical  solutions  that  a  statement  of  certain  rules  of  procedure 
in  practical  research  is  undoubtedly  worth  while.  Of  these  five 
may  be  mentioned. 

First,  study  the  operations  of  the  school  to  discover  the  points  at 
which  they  are  failing  to  function  efficiently.  This  study  may  be  in 
the  form  of  the  occasional  formal  survey  which  reveals  difficulties 
as  they  appear  to  imported  experts.  Or  it  may  be  the  sort  of 
study  which  is  carried  on  incidentally  by  the  superintendent  and 
supervisors  who  can  from  long  experience  place  their  fingers  upon 
the  weak  points  of  the  system.  Or  it  may  be  the  result  of  investi- 
gations carried  on  by  the  bureau  itself.  But  in  any  case  the  bureau 
should  have  at  its  command  a  picture  of  the  system  at  work  and  a 
list  of  the  points  at  which  it  fails  to  function  with  efiiciency. 

Second,  select  and  define  a  problem  for  investigation.  In  the 
selection  of  the  problem  three  factors  enter.  First,  other  condi- 
tions being  neutral,  the  most  important  problems  of  the  system 
should  be  selected.  Second,  the  resources  of  the  bureau  are,  also, 
a  determining  factor;  for  large  investigations  cannot  be  under- 
taken with  an  inadequate  personnel.  Third,  the  time  element 
must  likewise  have  weight,  because  confidence  in  the  work  of  the 
bureau  is  dependent  upon  fairly  frequent  solutions  of  some  prob- 
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lems  while  others  of  greater  magnitude  are  pending.  To  these 
may  possibly  be  added  the  individual  preferences  of  the  staff  as 
a  fourth  factor,  but  this  is  not  deserving  of  serious  consideration 
except  in  the  selection  from  among  several  problems,  each  equally 
appropriate  from  the  more  worthy  points  of  view.  The  definition 
of  the  problem  follows  as  a  matter  of  course  as  part  of  the  process 
of  investigation. 

As  an  illustration  of  the  rules,  I  shall  describe  the  develop- 
ment of  an  investigation  with  which  I  am  rather  intimately 
acquainted.  In  1915,  Superintendent  Cammack  of  Kansas  City 
arranged  for  the  selection  of  language  and  grammar  as  a  problem 
for  study.  He  did  so  because  he  recognized  from  his  long  experi- 
ence that  the  language  situation  was  serious  in  a  large  and  cosmo- 
politan community  such  as  Kansas  City.  Moreover,  the  time 
element  was  not  prohibitive,  and  the  investigation  was  not  larger 
than  could  easily  be  conducted  by  one  investigator  with  a  few 
assistants.  The  definition  of  the  problem  resulted  in  the  decision 
to  find  what  grammar  would  be  taught  if  it  were  based  on  the 
errors  of  school  children  with  the  aim  of  teaching  only  those 
rules  of  the  subject  which  were  broken  and  the  definitions  neces- 
sary to  understand  the  rules. 

The  third  rule  follows  naturally:  using  the  defined  problem 
as  the  central  element,  proceed  to  its  solution.  This  is  essentially  a 
laboratory  process.  The  problem  is  temporarily  taken  out  of  its 
setting  in  the  practical  operations  of  the  schoolroom,  the  literature 
is  canvassed,  subordinate  studies  are  made,  experts  are  con- 
sulted, and  a  solution  is  reached  which  it  is  hoped  will,  when 
applied  to  the  schools,  improve  instructional  practice.  While 
this  procedure  is  being  carried  on,  constant  regard  for  practice 
is  necessary  in  order  to  check  up  the  trend  of  the  solution  and 
the  form  it  will  finally  take.  If  the  solution  will  not  work  in 
practice  it  must  be  discarded  for  another  that  will.  As  a  result  of 
this  constant  consideration,  the  solution  finally  accepted  may  be 
quite  different  in  form  and  principle  from  that  which  was  origi- 
nally contemplated.  Preliminary  studies  must  often  be  tried  out 
in  a  small  way  to  discover  defects  before  proceeding  to  a  compre- 
hensive attack.  But  finally  the  solution  which  satisfies  the 
demand  of  the  defined  problem  will  be  obtained. 

Reverting  to  our  illustration,  we  observe  that  many  of  these 
processes  were  followed.     The  oral  and  written  errors  of  the 
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children  were  collected  by  the  teachers.  The  oral  errors  were 
classified.  Samplings  of  written  material  were  read  and  the 
mistakes  tabulated.  Errors  in  technic  were  corrected.  Defini- 
tions necessary  to  understand  the  rules  were  determined.  The 
material  was  systematically  arranged  and  comparison  of  this 
material  with  that  in  the  adopted  textbook  of  the  city  was  made. 
Finally,  the  findings  were  printed  in  a  bulletin  and  given  to  the 
teachers. 

At  this  point  it  seemed  at  the  time  that  our  job  was  com- 
pleted. We  had  published.  But  school  practice  had  not  been 
improved,  and  additional  steps  were  therefore  necessary. 

This  leads  to  the  fourth  rule.  Install  the  solution  in  the  practice 
of  the  school.  This  is  absolutely  essential  if  practice  is  to  be 
bettered  by  the  work  already  done.  Publications,  charts,  statis- 
tics, and  exhibits  do  not,  of  themselves,  mark  the  end  of  an  investi- 
gation. They  would  be  an  adequate  justification  of  pure  research, 
but  in  practical  research  the  final  test  is  found  only  in  the  improve- 
ment of  practice. 

Installation  is  the  Waterloo  of  many  investigators.  While 
they  are  solving  the  problem  in  the  laboratory,  they  are  dependent 
only  upon  their  own  efforts;  but  when  they  begin  to  install,  they 
must  reckon  with  the  peculiarities  of  people.  These  people  may 
lack  the  training  necessary  to  use  a  solution  too  highly  technical. 
Deep-seated  prejudices  may  be  encountered.  The  program  of 
studies,  the  textbooks  in  use,  the  available  supplies,  and  the 
crowded  character  of  the  curriculum  may  all  have  to  be  taken  into 
account.  The  hasty  investigator  may  grow  irritated  at  these  con- 
ditions and  blame  the  system,  the  board,  the  superintendent,  and 
the  teachers.  The  wise  investigator,  however,  considers  all 
these  factors  and  presents  a  solution  which  will  work  rather  than 
one  which  suits  him.  Or,  if  he  has  failed  to  foresee  all  the  difficul- 
ties, he  is  cheerfully  willing  to  make  the  adaptations  necessary 
to  produce  a  practical  solution. 

This  does  not  mean  that  at  times  the  bureau  should  not  stand 
for  its  own  solutions  against  the  opinions  of  the  rest  of  the  system. 
Such  situations  constantly  arise.  But  it  does  emphatically  mean 
that  the  bureau  must  sell  its  idea  to  the  instructional  and  adminis- 
trative staffs  if  it  hopes  to  put  them  into  operation.  Modification 
of  non-essentials  must  usually  be  made  if  the  essentials  are  pre- 
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served.  Fortunate  is  the  man  who  finds  his  methods  are  accepted 
and  used  without  modifications.  Cooperation  is  as  necessary  as  a 
good  solution  if  effective  use  is  to  be  made  of  the  findings.  Since 
teachers  and  administrators  must  apply  the  solution  in  order  to 
improve  practice,  a  practical  solution  is  valueless  if  it  is  not  used. 
Thus,  we  find  conferences,  committees,  and  educational  cam- 
paigns to  be  necessary  factors  in  installation.  While  this  sort  of 
work  is  distasteful  to  many  investigators,  it  is  an  absolutely  neces- 
sary part  of  the  work  of  a  bureau;  and  no  one  incapable  of,  or 
uninterested  in,  getting  the  cooperation  of  the  personnel  of  the 
schools  is  justified  in  being  on  the  bureau  staff  in  any  other  than 
a  clerical  capacity. 

In  the  case  of  the  grammar  study,  we  thought  at  first  that  with 
the  publication  of  the  report  our  work  was  completed.  But  it 
soon  became  evident  that  the  teachers  merely  read  the  report 
without  making  use  of  it.  A  number  of  factors  at  once  emerged. 
Not  all  the  staff  of  seventh-  and  eighth-grade  teachers  accepted 
our  basis  for  the  selection  of  the  content  of  grammar.  The  text- 
book in  use,  which  could  not  be  changed,  used  another  basis.  If 
the  report  was  adopted  and  certain  parts  of  the  text  were  left  out, 
the  exercises  which  followed  the  omitted  portions  might  occasion- 
ally depend  upon  them. 

As  a  result  of  these  conditions  a  committee  composed  of  high- 
school  teachers  and  grammar-grade  teachers,  selected  by  the 
teaching  force,  met  frequently  and  discussed  the  proposition  with 
great  frankness.  As  a  result  the  report  was  adopted,  the  textbook 
was  thoroughly  edited  and  portions  omitted,  together  with  later 
exercises  dependent  upon  these.  This  was  then  referred  to  the 
grammar-grade  teachers,  and  the  report  was  adopted  by  all. 
The  changes  made  necessary  in  the  text  were  printed  and  dis- 
tributed. 

Obviously,  a  much  better  solution  would  have  been  the  publi- 
cation of  a  grammar  text  which  carried  out  the  plan  of  the  report; 
but  it  was  necessary  for  us  to  reach  not  the  best  solution  so  much 
as  one  which  in  view  of  all  the  conditions  would  work. 

The  installation  advances  the  solution  one  step  but  it  does 
not  end  the  matter.  Although  practice  may  for  a  time  be  im- 
proved, the  improvement  may  turn  out  to  be  merely  temporary. 
Therefore,  the  fifth  rule  is  necessary:  provide  or  utilize  machinery 
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for  the  supervision  of  the  solutions.  The  bureau  is  concerned  with 
the  permanent  improvement  of  practice,  and  this  can  be  obtained 
only  by  supervision.  Mere  inspection  is  frequently  sufficient,  but 
in  many  cases  the  teachers  must  be  instructed  in  the  best  methods 
of  operating  the  solution. 

This  means  that  while  the  bureau  does  not  take  on  the  duties 
of  a  supervision,  it  must  see  that  supervision  is  maintained  and 
keep  close  watch  on  the  operation  of  the  solution  until  it  has 
become  an  integral  part  of  school  practice.  Its  duty  is  not  so 
much  that  of  inspection  as  that  of  constructive  assistance  in  iron- 
ing out  difficulties  of  adaptation  to  obstructive  conditions  or  to 
conditions  not  foreseen  until  the  operations  were  under  way. 

Reverting  to  the  grammar  study,  this  fifth  step  was  not  taken 
in  any  formal  way.  The  process  of  supervision  is  long  continued. 
The  cost  and  inconvenience  of  traveling  a  long  distance  made  it 
difficult  to  follow  the  process  of  supervision.  But  while  nothing 
formal  was  done,  the  subject  received  the  same  supervision  from 
the  supervisors  as  did  the  other  subjects  of  the  curriculum. 

It  is  a  detail  of  administration  as  to  whether  the  fourth  and 
fifth  steps  should  be  carried  on  by  the  bureau  or  by  some  other 
agency  in  the  system.  In  some  cases  the  superintendent  or  the 
supervisor  would  be  better  able  to  install;  in  others,  the  bureau 
would  be  the  logical  agency.  But  in  either  case,  the  job  is  not 
completed  until  practice  is  permanently  improved.  Therefore, 
bureaus  of  educational  research  owe  it  to  their  own  reputations 
for  efficiency  and  service  to  see  that  the  task  is  not  forsaken  until 
their  results  have  become  a  part  of  the  regular  practice  of  the 
school. 

w.  w.  c. 

EXCUSE  ME  ! 

In  Dr.  Chapman's  article  on  "Group  Intelligence  Tests  Without  Prepared 
Blanks"  in  our  December,  1920,  number,  the  footnote  was  ambiguous.  It  should 
have  read,  "Copies  of  this  test  may  be  secured  in  any  number  at  twenty-five 
cents  PER  COPY,  on  application  to  the  author  at  the  Department  of  Education, 
Yale  University."  The  words  "per  copy"  were  omitted  in  error.  Some  literal 
minded  people  have  been  ordering  large  quantities  of  the  test,  believing  that  they 
would  receive  the  entire  shipment  for  twenty-five  cents.  Each  copy  of  the  test  is 
twenty-five  cents — and  worth  the  money. 

Editor. 


S^m^ma  unh  Abfitrarta 

E.  H.  Cameron,  Editor 


EvENDEN,  E.  S.  Teachers'  salaries  and  salary  schedules  in  the  United  States,  1918-19. 
Washington:  National  Education  Association,  No.  6  of  series  of  Commission 
on  the  Emergency  in  Education,  1919.    169  pp. 

A  review  of  this  report  now  necessarily  differs  greatly  from  a  review  at  the  date  of 
publication,  October,  1919.  The  writer  was  not  asked  to  undertake  the  review  until 
the  fall  of  1920  and  other  duties  have  prevented  the  writing  until  January,  1921.  But 
so  valuable  is  the  report  that  even  at  this  date  a  review  is  thoroughly  worth  while. 

A  book  review  for  readers  of  the  Journal  of  Educational  Research  should  in 
the  writer's  judgment  answer  these  test  questions  which  are  given  in  order  of  impor- 
tance to  the  reader : 

1.  What  are  the  essential  results  of  the  investigation  that  are  of  importance  to 
readers  of  the  Journal? 

2.  What  classes  of  readers  should  read  the  book  or  purchase  it  for  their  school  or 
personal  libraries? 

3.  Did  the  educational  problem  treated  merit  the  time,  energy,  and  ability  of  the 
investigator  expended  upon  it? 

4.  How  nearly  did  the  work,  as  to  the  territory  covered  and  methods  employed, 
solve  the  problem  for  which  the  investigations  were  undertaken? 

5.  What  methods  of  investigation,  presentation  of  results  and  circulation  of 
reaults,  would  be  useful  in  similar  investigations? 

6.  What  further  investigations  of  importance  in  the  field  covered  by  this  investi- 
gation does  it  leave  to  be  done? 

1.  Many  readers  of  the  Journal  have  already  seen  the  report  and  so  have  formu- 
lated answers  for  themselves  to  the  first  two  questions.  Furthermore,  they  have  in 
many  cases  seen  summaries  or  extracts  from  it  in  various  national  and  local  educational 
periodicals  as  well  as  in  the  lay  press.  A  considerable  number  have  doubtless  assisted 
in  making  these  summaries  or  have  used  the  book  in  conducting  local  salary  studies. 
But  for  those  who  are  not  thus  familiar  with  it,  for  students  of  education  who  are 
preparing  for  administrative  positions,  and  for  clearness  in  this  discussion,  a  birdseye 
view  is  desirable. 

The  report  was  planned  by  the  Commission  on  the  Emergency  in  Education,  of 
which  Dr.  G.  D.  Strayer  was  chairman.  The  data  was  secured  by  questionnaires  in 
the  early  part  of  1919  and  the  report  itself  was  prepared  mainly  by  Dr.  E.  S.  Evenden. 
Data  were  collected  from  some  382  cities  of  all  sizes,  representing  all  kinds  of  economic 
and  social  conditions  in  all  parts  of  the  country,  and  from  10  county  school  systems. 

300 


April  mi  REVIEWS  AND  ABSTRACTS  301 

The  superintendents  filled  out  questionnaires  on  the  distributions  of  salaries,  on  salary 
schedules,  on  current  salary  standards,  and  on  the  cost  of  living  in  their  respective 
communities.  Some  15,000  teachers  in  these  same  school  systems  also  filled  out 
questionnaires,  giving  their  personal  data  on  such  of  the  items  as  affected  them.  State 
superintendents  of  pubUc  instruction  supplied  statements  of  the  general  salary  situa- 
tion in  their  own  states.  A  fourth  section  of  the  report  deals  with  teachers'  salaries 
and  the  cost  of  living  and  compares  the  salaries  of  teachers  with  those  in  similar 
occupations.  The  final  section  deals  with  the  present  situation  on  teachers'  salaries, 
lists  elements  to  be  considered  in  making  such  schedules,  suggests  a  standard  salary 
schedule  for  the  whole  country,  gives  advice  on  how  to  administer  such  a  schedule  and 
concludes  with  some  pertinent  observations  on  the  problem  of  arousing  public  interest 
in  teachers'  salaries.  The  conclusions  are  conveniently  summarized  in  point  form  for 
each  main  section.  This  is  a  thoroughly  workable  form  but  one  which  does  not  easily 
lend  itself  to  a  convenient  brief  digest  here. 

2.  Any  school  board  member,  any  school  executive  or  any  future  school  executive, 
who  aims  to  keep  abreast  of  the  times  educationally,  must  devote  much  time  and 
energy  to  the  crucial  matter  of  teachers'  salaries.  No  such  person  can  afford  to  work 
without  a  copy  of  this  report  in  the  school  library.  Any  school  executive  or  any  future 
school  executive  will  have  great  difficulty  in  procuring  more  value  for  his  professional 
library  from  $1 .  50  than  by  investing  that  amount  in  this  report. 

3.  In  early  1919  few  if  any  educational  problems  were  more  important  than  finding 
out  the  true  salary  situation  in  the  United  States  and  ways  of  keeping  intact  at  least 
skeleton  staffs  of  competent  teachers.  It  was  a  real  emergency  in  education.  Possibly 
the  study  of  ways  of  securing  more  money  for  schools  was  of  greater  importance  just 
then.  But  even  this  is  debatable  since  it  is  practically  impossible  to  secure  more  money 
for  public  schools  unless  there  are  at  least  enough  capable  teachers  to  demonstrate 
clearly  to  the  taxpayers  what  the  latter  are  expected  to  raise  more  money  for.  The 
problem  was  worthy  of  the  conspicuous  ability  and  best  efforts  of  the  commission 
that  dealt  with  it.  Indeed  it  deserved  the  undivided  attention  of  a  much  larger 
group  of  equal  caUber.  It  fully  merited  the  eight  months  devoted  to  it  by  the  man 
of  recognized  competence  who  shaped  it  for  effective  presentation  to  the  teaching 
profession  and  friends  of  education  throughout  the  country. 

4.  The  investigation  aimed  to  set  standard  salary  schedules  for  all  grades  of  teach- 
ers for  various  parts  of  the  country  and  sizes  of  cities.  It  aimed  to  check  up  the  validity 
of  these  standards  by  securing  the  facts  as  to  salaries  paid  teachers,  by  determining  the 
salaries  actually  necessary  to  maintain  teachers  at  reasonable  efficiency,  by  taking 
into  account  the  trend  of  the  times  as  seen  by  the  most  competent  judges  (the  state 
superintendents)  of  conditions  over  large  areas;  and  by  determining  what  salaries 
would  be  necessary  to  attract  capable  talent  in  competition  with  other  occupations. 
It  also  aimed  to  give  as  accurately  as  possible  a  desirable  salary  schedule  applicable 
to  city  systems  throughout  the  country  and  to  show  city  school  systems  how  to  enact 
and  operate  a  desirable  salary  schedule.  All  of  these  aims  are  markedly  achieved  in 
the  report. 

5.  The  report  will  serve  admirably  as  a  model  for  committees  investigating  salaries 
in  any  section  of  the  country,  whether  in  a  state  or  in  a  smaller  area.  It  points  out  the 
different  phases  to  be  studied,  it  shows  how  the  data  should  be  assembled  it  is  full  of 
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valuable  suggestions  for  effective  presentation  to  the  public,  and  its  questionnaires 
may  be  readily  modified  for  use  in  local  areas. 

In  addition  it  has  numerous  minor  conclusions  that  will  suggest  elaborations  of 
particular  phases  of  a  salary  investigation  to  investigators  where  such  phases  constitute 
particularly  acute  problems.  Thus  a  normal-school  president  will  derive  stimulus 
from  finding  on  page  98: 

Few  states  have  a  salary  schedule  for  their  normal  schools  which  will  bear 
comparison  with  the  salaries  in  the  better  high  schools  of  the  State.  As  a  nation 
we  spend  as  much  per  student  per  year  to  educate  any  high  school  pupil  or  any 
boy  in  the  reform  school  as  we  do  for  the  training  of  a  teacher  in  a  normal  school. 
We  spend  nearly  twice  as  much  for  a  pupil  in  a  deaf  school,  more  than  twice  as 
much  for  a  college  university  student,  three  times  as  much  for  a  blind  student, 
and  nearly  four  times  as  much  for  the  training  of  a  feeble  minded  child. 

Anyone  interested  in  combating  a  plan  to  employ  mainly  teachers  who  are  partially 
supported  by  their  parents,  or  in  securing  more  men  teachers  for  a  given  system,  will 
find  valuable  data  and  suggestions  on  pages  76-77.  Any  superintendent  or  school 
board  ought  to  take  fresh  courage  from  this  on  page  132: 

The  above  study  would  conclusively  indicate  that  this  question  of 
increases  to  teachers'  salaries  is  largely  a  matter  of  local  progress,  and 
depends  more  upon  the  development  of  a  favorable  community  attitude  or 
upon  the  aggressive  work  of  a  superintendent  or  teachers'  organization,  than 
upon  any  economic  development  of  the  community.  Such  a  study  is  evi- 
dence of  the  oft-quoted  statement  that  a  community  will  find  the  means  of 
supporting  schools  when  convinced  that  it  is  a  desirable  thing  to  do. 

The  suggested  standards  in  the  table  on  page  148  as  well  as  the  data  on  actual  sala- 
ries in  1919,  have  increased  value  because  of  the  present  nation-wide  financial  strin- 
gency. We  are  now  back  to  where  the  1919  figures  represent  current  conditions  more 
accurately  than  they  did  in  1920. 

6.  The  investigation  leaves  practically  untouched  the  salaries  of  rural  teachers 
and  thus  does  not  directly  treat  the  salary  problem  as  it  affects  the  majority  of  teachers 
in  the  country.  But  this  phase  could  not  have  been  adequately  treated  in  the  time 
available.  Furthermore  the  variations  and  allowances  for  local  conditions  are  much 
more  troublesome  to  handle  for  rural  teachers.  Then  too  rural  salaries  have  been  vitally 
affected  by  the  draining  off  of  rural  teachers  to  city  schools  even  faster  than  formerly. 
Increases  in  salaries  for  city  teachers  have  increased  rural  salaries  through  increased 
competition  for  the  better  rural  teachers.  The  commission  greatly  aided  rural  salaries 
by  its  report  even  if  it  did  not  study  them  directly.  And  it  wisely  confined  its  efforts 
to  what  could  be  adequately  studied  and  reported  in  time  to  be  of  actual  value.  Aside 
from  this  matter  of  rural  salaries,  the  report  leaves  little  of  importance  undone.  Of 
course  as  general  conditions  change,  similar  reports  will  be  desirable  in  the  future. 

Inquiry  No.  1  of  the  Know  and  Help  Your  Schools  movement  conducted  by  the 
National  Committee  for  Chamber  of  Commerce  Cooperation  with  the  Public  School 
and  by  the  American  City  Bureau  is  such  a  report  and  brings  the  figures  up  to  the  sum- 
mer of  1920.1 

Carter  Alexander 

Wisconsin  State  Department  of  Public  Instruction 

^  Published  by  American  City  Bureau,  New  York,  Chicago,  San  Francisco,  and  Toronto. 
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Van  Wagenen,  Marvin  J.  Historical  information  and  judgment  in  pupils  of  elemen- 
tary schools.  (Teachers  College  Contributions  to  Education  No.  101)  New  York: 
Teachers  College,  Columbia  University,  1919.  74  pp. 

Van  Wagenen  has  devised  seven  scales.  Information  A,  Information  B,  Thought 
A,  Thought  B,  Character  A,  Character  B,  and  Character  L.  The  A  and  B  scales  appear 
not  to  be  exactly  equivalent  but  are  intended  to  be  used  as  duplicate  forms.  Each  of 
the  scales  consists  of  a  series  of  exercises  arranged  in  order  of  diiEculty  as  determined 
by  the  percent  of  correct  responses  obtained  by  submitting  them  to  pupils  in  grades 
four  to  eight.    The  pupil's  score  in  each  case  is  the  number  of  correct  responses. 

The  author  states  that  "the  chief  desiderata  in  instruments  for  measuring  achieve- 
ment in  American  history  are  (1)  that  the  tasks  be  symptoms  of  important  abilities 
really  desired  by  the  school;  (2)  that  the  tasks  be  not  too  much  disturbed  by  linguistic 
difficulties  so  that  ability  in  history,  not  in  reading  or  composition,  may  be  chiefly 
measured;  (3)  that  the  measurement  of  a  small  group,  such  as  a  class  of  twenty- five  or 
more,  be  made  with  sufficient  precision;  (4)  that  the  tests  be  capable  of  extension  to 
alternative  forms  so  as  to  reduce  the  harm  done  by  special  preparation  or  coaching  for 
the  tests;  and  (5)  that  the  administration  and  scoring  of  the  tests  be  convenient." 

The  author  states  that  he  is  leaving  the  reader  to  judge  for  himself  concerning 
the  fulfillment  of  the  first  two  of  these  requirements.  Nowhere  in  the  monograph 
does  he  give  any  account  of  the  construction  of  the  exercises.  Usually  in  making  such 
a  group  of  tests  the  author  finds  that  it  is  necessary  to  reject  a  number  of  exercises  that 
have  been  constructed  because  they  do  not  yield  satisfactory  responses  when  sub- 
mitted to  pupils.  Presumably  Dr.  Van  Wagenen  must  have  had  this  same  experience. 
It  is  unfortunate  that  he  does  not  tell  us  the  way  in  which  he  arrives  at  the  particular 
exercises  which  constitute  his  tests.  One  writer^  has  pointed  out  that  a  number  of  the 
exercises  in  the  thought  scales  appear  to  call  for  factual  information.  To  the  extent 
to  which  this  is  true  the  thought  scale  is  simply  another  information  scale.  Thus  it  is 
doubtful  whether  the  first  two  requirements  have  been  satisfied. 

The  author  shows  that  the  other  three  requirements  are  met  by  these  scales. 
The  coefficient  of  reliability,  using  pupils  of  the  same  sex  and  grade,  are  0. 71  for  infor- 
mation, 0.74  for  thought  and  0.83  for  character.  The  probable  error  of  these  coeffi- 
cients is  given  as  +0.01.  The  mean  square  error  of  a  pupil's  score  is  approximately 
0.7  for  the  information  and  thought  scales,  and  0.6  for  the  character  scales. 

In  addition  to  the  derivation  of  the  scale  the  writer  investigated  grade,  age,  and 
sex  differences.  The  usual  individual  differences  were  found  in  the  case  of  grade  and 
age.    In  the  case  of  sex  differences  boys  were  found  distinctly  superior  to  girls. 

The  general  plan  of  the  construction  of  these  scales  in  that  which  has  been  used 
by  Buckingham,  Trabue,  Woody,  and  others.  The  work  of  Dr.  Van  Wagenen,  there- 
fore, exhibits  no  originality  in  this  respect.  However,  if  this  plan  of  scale  derivation  is 
accepted,  as  it  apparently  is,  there  is  no  opportunity  for  originality.  As  stated  above 
the  author  fails  to  tell  how  the  particular  exercises  of  the  scales  were  selected  and 
therefore  we  cannot  know  whether  there  is  any  originality  in  this  phase  of  the  work  or 
not.    So  far  as  one  may  judge  from  the  published  scales  this  seems  doubtful. 

W.  S.  M. 

»  Buckingham,  B.  R.  "A  proposed  index  of  e£Bciency  in  teaching  United  States  history,"  Journal  oj 
Educational  Research,  1:161-71,  March,  1920. 
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Betts,  G.  H.  How  to  teach  religion:  principles  and  methods.    New  York:  Abingdon 
Press,  1919.  223  pp. 

There  is  a  growing  movement  in  America  toward  better  methods  in  religious  edu- 
cation. The  Protestant  churches  are  waking  to  the  weakness  of  the  policy  which 
relies  upon  preaching  to  the  neglect  of  teaching,  and  undertakes  the  conversion  of 
adults  rather  than  the  Christian  nurture  and  education  of  children.  It  has  become 
clear,  moreover,  that  the  very  magnitude  and  efl&ciency  of  our  system  of  public  educa- 
tion may  operate,  because  of  its  omission  of  religious  teaching,  to  discredit  religion 
in  the  minds  of  the  young.  If  education  and  religion  are  not  ultimately  to  be  divorced, 
the  churches  must  assume  responsibility  for  the  religious  education  of  children  with 
something  like  the  same  clarity  of  purpose,  soundness  of  method,  and  eflSciency  of 
organization  that  should  characterize  the  work  of  the  public  schools. 

The  past  twenty  years  have  witnessed  the  introduction  of  graded  lessons  into 
the  Sunday  schools  and  the  gradual  displacement  of  the  old  uniform  lesson  system 
whereby  the  same  material  was  taught  to  children  and  adults  of  all  ages.  The  churches 
are  coming  to  realize,  moreover,  that  the  religious  education  of  children  involves  not 
merely  instruction  but  activity,  and  they  have  begun  to  match  the  project  methods 
of  the  public  schools  with  plans  for  the  comprehensive,  motivated  education  of  children 
in  the  problems  and  principles  of  Christian  living.  With  this  has  come  a  rapidly  grow- 
ing demand  for  week-day  religious  instruction,  and  in  many  communities  the  public 
schools  are  now  affording  to  the  churches  for  this  purpose  one  or  more  hours  a  week 
from  their  schedule.  Many  churches  now  pay  some  of  the  teachers  in  their  Sunday 
schools,  and  employ  directors  of  religious  education,  who  give  their  full  time  to  the 
supervision  of  the  church's  plans  for  the  education  of  its  children,  young  people,  and 
adults.  Theological  seminaries  generally  have  instituted  departments  of  religious 
education  in  which  students  are  trained  for  the  educational  aspects  of  their  future  work 
as  Christian  ministers. 

Professor  Betts,  who  was  for  many  years  the  head  of  the  department  of  psychology 
and  education  at  Cornell  College,  two  years  ago  accepted  a  professorship  of  Religious 
Education  in  Northwestern  University.  This  book  is  the  first  fruitage  of  his  labor  in 
this  new  field. 

All  good  teaching,  Professor  Betts  holds,  rests  on  a  four-fold  foundation  of  prin- 
ciples: those  concerned  with  the  aims  of  teaching,  the  material  or  subject-matter  of 
teaching,  the  organization  of  the  curriculum,  and  the  method  or  technic  of  instruction. 
He  discusses  "how  to  teach  religion"  from  each  of  these  four  points  of  view.  He 
defines  the  aim  of  religious  teaching  in  terms  of  knowledge,  attitudes,  and  conduct; 
and  devotes  successive  chapters  to  the  consideration  of  what  religious  knowledge  is  of 
most  worth,  what  religious  attitudes  are  to  be  cultivated,  and  how  religious  knowledge 
and  religious  attitudes  may  be  used  to  shape  the  conduct  of  daily  life.  There  is  a 
chapter  upon  the  evaluation  of  materials,  biblical  and  extra-biblical,  including  mate- 
rials drawn  from  nature,  history,  biography,  art,  and  music.  In  a  chapter  on  the 
organization  of  material  there  is  a  brief  discussion  of  the  principles  underlying  the 
construction  of  a  curriculum  of  religious  education — the  problem  to  which  Professor 
Betts  with  his  graduate  students  is  particularly  devoting  himself.  The  last  four 
chapters  of  the  book  discuss  methods  of  teaching  religion  with  all  the  concreteness  and 
insight  which- have  been  characteristic  of  Professor  Betts'  discussions  of  like  problems 
of  method  in  the  public  schools. 
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Readers  of  the  author's  former  books,  especially  "The  Mind  and  Its  Education," 
"The  Recitation,"  and  "Social  Principles  of  Education"  will  expect  just  the  fresh, 
vigorous,  concrete  treatment,  sound  in  principle,  which  is  here  afforded.  Now  and 
then  there  is  evidence  that  he  is  at  work  in  a  field  comparatively  new  to  him.  Occa- 
sional slips,  such  as  attributing  the  Epistle  of  the  Hebrews  to  Paul,  show  that  the 
author  is  not  as  well  trained  in  Biblical  literature  and  theology  as  in  psychology  and 
pedagogy.  His  criticisms  of  existing  curricula,  while  for  the  most  part  sound,  do  not 
bear  the  marks  of  actual  classroom  experience  with  this  material.  Professor  Betts  is 
not  writing  for  theologians,  however,  or  for  lesson-writers,  but  for  the  great  body  of 
those  who  teach  religion.  On  the  whole  his  book  is  the  best  that  we  have  in  its  field, 
and  is  a  very  welcome  addition  to  the  church's  resources  as  it  faces  the  problem  of 
how  to  make  religion  an  effective  part  of  the  education  of  children. 

L.  A.  Weigle 
Yale  University 


N^mH  Sterna  anJn  OlnmrnumrattunH 

This  department  will  contain  news  items  regarding  research  workers 
and  their  activities.  It  will  also  serve  as  a  clearing  house  for  more  formal 
communications  on  similar  topics,  preferably  of  not  more  than  five  hundred 
words.  These  commimications  will  be  printed  over  the  signatures  of  the 
authors.  Address  all  correspondence  concerning  this  department  to  Walter 
S.  Monroe,  University  of  Illmois,  Urbana,  Illinois. 


The  conference  on  educational  measurements  held  annually  by  Indiana  Univer- 
sity will  take  place  this  year  on  Friday  and  Saturday,  April  22  and  23.     Mr.  S.  A. 
Courtis  of  Detroit  will  give  three  addresses  before  the  conference, 
Friday  morning,  afternoon,  and  evening.    Dr.  Charles  H.  Judd  of  the 
Indiana  University  of  Chicago  will  address  the  conference  on  Saturday  morning 

Conference     and  afternoon.    Reports  of  the  discussions  will  be  contributed  by  mem- 
bers of  the  Indiana  University  faculty  of  the  School  of  Education.  This 
is  the  oldest  and  also  one  of  the  best  known  conferences  on  this  topic.    The  speakers 
secured  for  this  year  insure  the  usual  degree  of  excellence  of  the  program. 

Within  the  last  few  years  a  number  of  university  normal  schools  have  established 
departments,  which  are  given  some  such  titles  as  "Bureau  of  Educational  Research" 
or  "Bureau  of  Educational  Measurements."  In  some  instances  the  function  of  such 
an  organization  is  considered  to  be  primarily  that  of  research.  This 
Extension  research  is  to  be  carried  on  in  cooperation  with  the  school  men  of  the 
Service  of  state  and  frequently  is  based  upon  problems  which  are  suggested  by 
Research  them.  In  other  instances  the  major  function  of  the  organization  of  the 
Bureaus  department  has  been  considered  to  be  that  of  instructing  superintendents, 

principals,  and  teachers  in  the  use  of  educational  tests  and  other  scienti- 
fic methods.  This  has  been  done  by  regular  extension  classes  and  by  conferences. 
Recently  this  department  received  an  account  of  some  of  the  work  which  is  being 
carried  on  this  year  by  the  Bureau  of  Educational  Measurements  and  Standards  of  the 
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Kansas  State  Normal  School,  Emporia,  Kansas.  Since  this  is  one  of  the  oldest  of  such 
organizations  it  is  interesting  to  note  this  statement  by  the  director:  "We  have  given 
the  National  Intelligence  Test  to  the  children  of  the  elementary  schools  of  Junction 
City,  Fredonia,  and  Clearwater.  Next  week  we  shall  give  them  in  Holcomb  and 
Cimarron.  Extension  classes  are  being  conducted  in  three  centers.  We  have  had  more 
calls  for  assistance  of  this  type  than  our  force  will  allow  us  to  handle.  Next  year  we 
hope  to  have  one  man  give  his  full  time  to  field  work." 

This  plan  was  indorsed  at  the  City  Superintendents'  and  High  School  Principals' 
Sections  of  the  Council  of  Administration,  January  20,  192  L  It  includes  both  a  defi- 
nition of  school  marks  and  a  definition  of  the  distribution  of  these 
The  Kansas  marks.  The  plan  represents  an  attempt  to  make  more  scientific  and 
Uniform  Grad-  accurate  the  marking  of  high-school  pupils.  The  plan  has  been  in 
ing  Plan  operation  in  a  number  of  high  schools  in  Kansas  for  sometime.  The 

indorsement  does  not  make  obligatory  the  use  of  the  plan  but  no 
doubt  it  will  be  adopted  by  a  large  number  of  high  schools  in  the  state.  The  plan  was 
formulated  by  a  committee  of  which  W.  W.  McConell,  principal  of  the  high  school, 
Neodesha,  Kansas,  was  chairman. 

DEFINITION  OF  GRADES 
Grade  or  A 

1.  Scholarship — Exceeding  expectations  of  instructor. 

2.  Initiative — Contributions  exceeding  the  assignment. 

3.  Attitude — Positive  benefit  to  the  class. 

4.  Cooperation — Forwarding  all  group  activities. 

5.  Individual  Improvement — Actual  and  noticeable. 

Grade  or  B 

1.  Scholarship — Accurate  and  complete. 

2.  Initiative — Stimulating  some  desirable  achievements. 

3.  Attitude — Proper  and  beneficial. 

4.  Cooperation — Effective  in  group  work. 

5.  Individual  Improvement — Showing  marks  of  progress. 

Grade  of  C 

1.  Work  in  general  of  medium  quality. 

2.  Work  quite  strong  in  one  or  more  items  but  weak  in  others. 

Grade  of  D 

(This  grade  might  be  produced  by  any  variety  or  combination  of  weaknesses  as 
the  definition  suggests.) 

1.  Scholarship — Barely  meeting  assignments. 

2.  Initiative — Uncertain,  not  usually  manifest. 

3.  Attitude — ^Not  objectionable,  usually  neutral. 

4.  Cooperation — ^Not  positive  nor  very  effective. 

5.  Individual  Improvement — Slight,  not  positive. 
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Grade  op  F 

1.  This  is  a  failing  grade  and  since  it  may  result  from  any  number  of  weaknesses  is 
not  defined. 

Distribution  oh  Grades 

This  is  a  very  important  factor  of  this  system  of  grading.  Within  the  class  and 
within  the  school  it  is  expected  that  a  proper  respect  be  paid  to  the  normal  curve  of 
frequency.  However,  the  grades  are  not  to  be  made  primarily  for  the  purpose  of  fitting 
the  curve.  The  curve  is  to  be  used  as  a  check  to  see  what  the  "norm"  should  be  under 
usual  conditions  and  with  large  enough  group.  It  is  expected  that  a  teacher  be  able 
to  justify  his  variation  in  grade  distribution  from  the  normal  curve  of  frequency. 

Normal  Curve  of  Frequency 

The  curve  is  built  upon  the  following  percentages:  A — 7%,  B — 24%,  C — 38%, 
D— 24%,  F— 7%. 

FUNCTION  OF  THIS  SYSTEM 

With  this  code  a  teacher  should  grade  carefully  and  be  able  to  defend  every  grade 
given.  It  should  be  pointed  out  to  the  student  with  a  low  grade  that  he  is  falling  short 
of  the  standard  in  some  one  of  these  valuable  qualities.  Teachers  have  long  felt  the 
need  of  definite  points  of  defense  when  questioned  about  a  grade  but  these  five  desirable 
qualities  need  emphasis  and  should  be  used  in  conferences  with  students.  It  is  essential 
that  students  understand  this  system  as  thoroughly  as  do  the  teachers.  This  will  give 
students  a  secure  sense  of  direction  in  attempting  improvement. 

In  this  grading  system  teachers  should  bear  in  mind  that  grades  are  given  on  a 
comparative  basis  only;  every  student's  work  is  to  be  compared  with  that  of  every 
other  student  with  whom  he  works,  and  grades  are  to  be  arranged  according  to  his 
ranking  in  the  class.  This  will  apply  to  every  point  under  the  "definition  of  grades" 
as  scheduled  above.  In  no  case  is  any  grade  to  be  translated  to  or  thought  of  in  terms 
of  percents,  but  students  are  to  learn  that  if  they  make  A  or  B  grades,  they  are  con- 
sidered to  belong  to  approximately  the  upper  one- third  of  the  class;  if  they  are  C 
students,  they  belong  to  approximately  the  middle  one-third  of  the  class;  and  if  they 
rank  below  C  they  are  among  approximately  the  lower  one-third  of  the  class. 

WEIGHTED  CREDITS 

(Suggested  by  the  committee  but  not  recommended  unless  it  received  the  sanction  of 

the  state  department) 

1.  Grade  of  A  for  unit  subject,  1.2  units. 

2.  Grade  of  B  for  unit  subject,  1 . 1  units. 

3.  Grade  of  C  for  imit  subject,  1  unit. 

4.  Grade  of  D  for  unit  subject,  0.9  unit. 

5.  Grade  of  F  for  unit  subject,  no  credit. 

Training  Teachers  to  Use  the  New  York  City  Penmanship  Scale 

Our  readers  will  remember  the  article  by  Mr.  Nifenecker  on  "Grade  Norms  for 
the  New  York  City  Penmanship  Scale,"  which  appeared  in  our  December,  1920, 
number._The  Bureau  of  Reference,  Research  and  Statistics,  of  which  Mr.  Nifenecker 
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is  director,  has  lately  succeeded  in  making  up  sets  of  practice  material  for  teachers  to 
use  in  training  their  judgment  of  handwriting  by  the  use  of  the  New  York  City  Pen- 
manship Scale. 

This  practice  material  consists  of  two  series  of  facsimile  samples,  each  series  con- 
sisting of  twenty  samples.  In  addition  to  this  there  is  a  third  series  of  twenty  samples 
which  is  used  as  a  test  series.  The  two  practice  series  are  used  in  the  following  manner : 
The  principal  distributes  a  practice  series  (Series  A)  to  his  teachers.  The  teachers  then 
rate  the  samples  of  this  series  against  the  scale,  taking  account  of  form,  movement,  and 
spacing.  After  the  teachers  have  done  this  their  results  are  checked  by  the  principal 
against  the  known  values  of  the  samples  which  have  been  furnished  to  him.  A  confer- 
ence with  each  teacher  ensues  during  which  the  greatest  variations  from  the  standards 
are  taken  up.  Again  the  teacher,  using  the  practice  series,  will  rate  the  samples 
against  the  scale.  This  procedure  is  carried  on  until  the  teacher's  variation  from  the 
established  values  of  the  samples  has  been  materially  reduced.  As  a  final  check  on  the 
accuracy  of  the  teacher's  judgment  the  test  series  of  samples  is  used. 

As  has  been  indicated  above,  an  alternative  practice  series  (Series  B)  is  also  pro- 
vided. It  is  to  be  used  when  familiarity  with  the  A  series  has  made  its  further  use 
undesirable. 

This  follow-up  of  the  New  York  City  Penmanship  Scale  on  the  part  of  the  Bureau 
of  Reference,  Research  and  Statistics  constitutes  a  fine  example  of  carrying  through 
a  research  project  to  the  point  not  only  of  installation  but  also  of  supervision. 


Correlation  of  Certain  Intelligence  Tests  for  the  Lower  Grades 

In  these  columns  of  a  recent  issue  of  the  Journal  appeared  a  discussion  of  the 
Illinois  General  Intelligence  Scale  based  upon  data  furnished  by  Superintendent  L. 
W.  Keeler  of  Michigan  City,  Indiana.  From  the  same  source  the  Bureau  of  Educa- 
tional Research  has  also  received  scores  of  a  number  of  lower  grade  pupils  on  several 
tests.  About  20  pupils  in  the  first  grade,  an  equal  number  in  the  third  grade,  and  35 
in  the  second  grade  were  given  the  Stanford  Revision  of  the  Binet-Simon  Tests,  the 
Dearborn  Group  Tests  of  Intelligence,  and  the  Kingsbury  Primary  Group  Intelligence 
Scale.  For  purposes  of  correlation  the  mental  ages  in  months  on  the  first  mentioned, 
the  average  point  scores  on  the  second,  the  point  scores  on  the  last,  and  the  average 
of  these  two  latter  scores  were  used.  Throwing  the  scores  for  the  pupils  of  the  three 
grades  together,  the  following  coefficients  were  obtained : 

Stanford  with  Dearborn 0.87 

Stanford  with  Kingsbury 0 .  73 

Stanford  with  Average 0 .  87 

Dearborn  with  Kingsbury 0.75 

Dearborn  with  Average 0.92 

Kingsbury  with  Average 0.89 

Assuming  that  the  Stanford  Revision  is  a  standard  for  group  intelligence  tests,  these 
figures  imply  that  both  the  other  tests  are  rather  accurate,  the  Dearborn  being  so  to  a 
high  degree  and  as  good  as  the  average  of  the  two. 

The  correlation  coefficients  for  the  three  grades  separately  were  also  computed. 
They  were: 
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Grades 


I 


II 


III 


Stanford  with  Dearborn . . 
Stanford  with  Kingsbury . 
Stanford  with  Average  . . . 
Dearborn  with  Kingsbury 


0.66 
0.32 
0.61 
0.53 


0.78 
0.53 
0.71 
0.54 


0.60 
0.60 
0.66 
0.47 


These  coefficients  indicate  that  the  superiority  of  the  Dearborn  Test  is  with  the  younger 
pupils,  but  that  later  it  possesses  no  advantage  over  the  Kingsbury. 

However,  the  matter  may  be  looked  at  from  another  viewpoint.  The  following 
table  gives  the  means,  medians,  standard  deviations  and  coeflficients  of  variation 
(Pearson's  formula). 


Grades 

I  II 

Medians 

Dearborn 28  44 

Kingsbury 21  30 

Means  {Averages) 

Dearborn 27  44 

Kingsbury 22  32 

Standard  Deviations 

Dearborn 9.7  12.8 

Kingsbury 6.2  16.3 

Coefficients  of  Variation 

Dearborn 36  29 

Kingsbury 28  51 


Since  the  two  tests  are  both  scored  on  a  scale  of  100  points  and  the  distributions 
obtained  in  the  two  are  located  not  far  from  the  same  portion  of  the  scale,  standard 
deviations  and  coeflScients  of  variation  seem  to  indicate  that  in  grades  ii  and  iii,  the 
Dearborn  Tests  are  suitable  for  testing  a  group  of  greater  range  of  ability  than  is  the 
Kingsbury  Scale,  but  that  the  latter  is  scored  in  smaller  units  and  hence  discriminates 
more  finely.  In  grade  i  the  reverse  seems  true.  The  increases  from  grade  to  grade, 
which,  as  judged  by  the  Dearborn,  are  almost  equal,  while  by  the  Kingsbury  that  from 
grade  i  to  ii  is  less  than  one-half  of  that  from  n  to  in,  also  point  to  this  conclusion. 

There  is  another  possible  interpretation  of  the  data  given  above,  however.  Other 
things  being  equal,  the  greater  the  accuracy  of  a  test  the  less  its  variation.  Though 
our  data  are  not  sufficient  to  say  that  all  other  things  are  equal,  yet  since  both  tests 
cover  a  range  of  100  points  and  the  averages  of  the  distributions  are  fairly  close  to 
each  other,  these  facts  furnish  some  evidence  that  the  Dearborn  is  the  more  accurate 
in  the  two  upper  grades,  and  the  Kingsbury  in  grade  i. 

On  the  whole,  the  evidence  obtained  from  the  coefficients,  both  of  correlation  and 
of  variation,  and  from  the  increases  in  score  from  grade  to  grade  seems  to  point  to  the 


Grades 

Continued 

III 

. 

59 

43 

S3 

30 

59 

43 

59 

36 

10.0 

15.9 

21.3 

20.5 

17 

37 

36 

57 
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fact  that  the  Deaxbom  is  somewhat  superior  to  the  Kingsbury  for  the  three  grades 
mentioned.  Whether  or  not  this  superiority  is  great  enough  to  justify  the  at  least 
double  expenditure  of  time  required  in  its  administration  is  a  question  the  writer  pre- 
fers not  to  attempt  to  answer. 

C.  W.  Odell 
University  of  Illinois 

A  Method  of  Tabulating  Scores  in  Group  Testing 

During  the  early  fall  of  1920  the  seventh  and  eighth  grades  of  two  Boston  schools 
were  given  the  Dearborn  Group  Tests  of  Intelligence.  After  the  tests  had  been  cor- 
rected, it  was  decided  that  it  was  unwise  to  report  the  results  to  teachers  and  adminis- 
trators in  the  form  of  intelligence  quotients.  It  was  believed  that  the  chance  of 
misinterpreting  such  returns  by  teachers  and  parents  was  great  enough  to  warrant 
seeking  some  new  method  of  making  a  report  to  the  school. 

After  trying  various  ways  of  treating  the  distributions,  it  was  decided  that  the 
method  described  in  this  communication  met  all  the  necessary  requirements  and  made 
it  possible  to  locate  each  pupil  within  certain  ranges,  which  were  near  enough  to  actual 
conditions  for  all  practical  purposes. 

After  the  papers  were  corrected  a  distribution  was  made  of  all  scores  of  each  grade 
tested  regardless  of  age.  The  median,  and  the  first,  and  third  quartiles  of  the  distribu- 
tion for  each  grade  were  then  determined.  Following  this,  a  distribution  of  scores  on 
a  basis  of  age  regardless  of  the  grade  was  made.  That  is,  all  pupils  were  divided  into 
age  groups  of  six  months  each,  10  years  to  10  years,  5  months;  10  years,  6  months  to  10 
years,  11  months;  11  years  to  11  years,  5  months,  etc.  Then  a  distribution  of  the  scores 
for  each  of  these  age  groups  was  made  and  the  median,  and  first,  and  third  quartiles 
were  found.  Then  a  third  distribution  was  made  in  which  the  pupils  were  grouped 
according  to  ages.   The  median  age,  and  the  first,  and  third  quartiles  were  found. 

It  was  now  possible  to  place  each  pupil  in  his  proper  quarter  according  to  each  of 
these  distributions  and  thus  to  obtain  his  grade-score,  his  age-score,  and  his  chron- 
ological age  (in  terms  of  quarters).  Table  I  and  Table  II  show  the  way  each  class  was 
reported  to  the  school.  The  first  quarter  shows  a  high  score  or  high  age  and  the 
fourth  quarter  shows  low  score  or  low  age.  Under  pupils'  names  letters  have  been 
used  instead  of  names  to  indicate  pupils.  This  report  shows  that  most  of  the  pupils 
fell  in  the  first  or  second  quarter  of  the  distribution  in  both  grade  score  and  age  score 
with  only  one  (Z)  falling  in  the  fourth  quarter.  Sixteen  are  young  for  their  grade  as 
shown  by  the  fact  that  they  are  in  the  fourth  quarter  and  only  four  are  old  for  their 
grade  as  shown  by  the  fact  that  they  are  in  the  first  quarter.  In  other  words,  this  is  a 
superior  class. 
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TABLE  I.      SHOWING  SEX,  AGE,  SCORE,  AND  QUARTILE  STANDING  OF 
32  EIGHTH-GRADE  PUPILS,  ROOM  346 


Sex 

Pupil's 

Name 

Age 

Pupil's 
Score 

Quaktile  Standing 

Grade 
Score 

Age 
Score 

Age 

B 

A 
B 
C 
D 
E 
F 
G 
H 
I 

J 
K 
L 

M 
N 
0 
P 

Q 

R 

S 

T 

U 

V 

W 

X 

Y 

Z 

AA 

BB 

CC 

DD 

EE 

FF 

13-1 

12-5 

12-3 

12-10 

13-1 

13-5 

13-3 

13-3 

12-4 

13-3 

12 

12 

12-4 

12 

12-6 

12-10 

12-3 

11-10 

12 

13-3 

11-11 

12-7 

13-10 

11-11 

12-6 

15-6 

14-2 

12-3 

12-3 

12-11 

13-5 

13-8 

68 
66 
64 
71 
61 
72 
68 
72 
65 
61 
73 
71 
57 
58 
78 
81 
69 
87 
59 
59 
45 
69 
53 
62 
69 
30 
61 
55 
83 
79 
51 
78 

2 

1 

1 
1 
1 

1 
1 
1 
1 
1 
1 
1 
1 
1 
2 
2 
1 
1 
1 
1 
1 
2 
3 
1 
2 
1 
1 
4 
1 
2 
1 
1 
2 
1 

3 

G 

4 

B 

4 

G 

3 

G 

3 

G 

2 

B 

2 

B 

2 

G 

4 

B 

2 

G 

4 

B 

4 

B 

4 

B 

4 

B 

4 

G 

3 

G 

4 

G 

4 

B 

4 

B 

2 

G 

4 

G 

3 

G 

1 

G 

4 

B 

4 

B 

1 

G 

1 

G 

4 

B 

4 

G 

3 

G 

2 

B 

1 
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TABLE  II.     SHOWING  SEX,  AGE,  SCORE,  AND  QUARTILE  STANDING 
OF  40  EIGHTH-GRADE  PUPILS,  ROOM  347 


Six 


Pxtpil's 

Name 


Age 


Pupil's 
Score 


QuARTiLE  Standing 


Grade 
Score 


Age 
Score 


B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 
B. 


A 
B 
C 
D 
E 
F 
G 
H 
I 

J 
K 
L 
M 

N 
O 
P 

Q 

R 

S 

T 

U 

V 

W 

X 

Y 

Z 

AA 

BB 

CC 

DD 

EE 

FF 

GG 

HH 

II 

JJ 
KK 
LL 
MM 

NN 


14-2 

13-10 

13 

14-2 

15-1 

14^3 

13-5 

13-9 

14-5 

13-8 

14r-2 

13 

13-5 

13-10 

12-11 

13-10 

12-10 

14 

14^11 

14^2 

18-3 

13-5 

13-11 

15-9 

15 

14^2 

13-10 

17 

14-1 

15-1 

13-2 

14^7 

13-4 

14^ 

14^7 

14^5 

12-5 

13-6 

15-9 

13-6 


69 

71 
48 
69 
40 
75 
45 
65 
29 
77 
64 
46 
57 
25 
35 
37 
31 
48 
50 
i2> 
16 
41 
20 
47 
55 
56 
63 
31 
41 
41 
41 
52 
39 
53 
45 
49 
41 
41 
49 
42 
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In  Table  II  one-half  of  the  pupils  fall  in  the  third  or  fourth  quarter  of  the  distribu- 
tion in  both  grade-score  and  age-score,  while  thirteen  attain  a  score  which  places  them 
in  the  first  or  second  quarter.  One  pupil  is  young  for  his  grade  as  shown  by  the  fact 
that  he  is  in  the  fourth  quarter  and  28  pupils  are  old  for  their  grade  as  shown  by  the 
fact  that  they  are  in  the  first  quarter  of  the  distribution.  In  other  words,  these 
pupils  are  mentally  inferior  to  the  children  in  room  346.  If,  however,  the  tests  are  telling 
the  truth,  room  347  is  poorly  graded  as  shown  by  the  range  of  scores  from  16  to  77. 

A.  W.  Kallom 
Department  of  Educational  Investigation  and  Measurement, 

Boston,  Massachusetts 


Norms  for  the  Otis  Group  Intelligence  Scale 

The  norms  for  the  Otis  Group  Intelligence  Scale  presented  by  Dr.  Colvin  in  the 
January  number  of  the  Joxirnal  of  Educational  Research  cause  me  some  concern. 
As  he  mentions,  they  differ  from  the  norms  published  by  Dr.  Otis,  but  what  is  of  more 
importance  to  us  locally  is  that  they  differ  still  more  from  the  norms  we  have  derived 
from  local  data.    The  following  table  shows  the  differences: 


Age 

Otis 

Colvin 

Cincinnati 

Norms 

Norms 

Norms 

8 

40 

58 

30(4) 

m 

46 

70^ 

36(9) 

9 

52 

67y2 

42(22) 

9y2 

58 

7m 

48(66) 

10 

64 

soy2 

54(67) 

lOM 

70 

90 

60(91) 

11 

76 

94 

66(105) 

iiM 

82 

109 

72(111) 

12 

88 

118 

78(101) 

12^ 

94 

1193^ 

84(91) 

13 

100 

130 

90(101) 

13>i 

106 

133 

96(112) 

14 

112 

1351^ 

102(85) 

uy2 

117 

my2 

108(49) 

15 

121 

136 

114(40) 

The  figures  in  parenthesis  indicate  the  number  of  pupils  at  each  age  taking  the 
test.  Two  schools  were  selected  for  the  testing,  upon  which  these  norms  are  based, 
by  conference  with  the  supervisors.  One  school  was  considered  a  Uttle  below  average 
and  the  other  a  Uttle  above.  A  combination  of  the  records  from  both  schools  was 
thought  to  be  representative  of  Cincinnati.  Our  norms  were  derived  before  the  final 
norms  of  Dr.  Otis  were  published.  The  work  was  carefully  done  and  the  results  have 
agreed  very  satisfactorily  with  Stanford  results  and  with  grade  placement. 
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The  use  of  either  the  Otis  or  Colvin  norms  would  give  us  absurd  results.  We  are 
not  inclined  to  believe  that  Cincinnati  school  children  are  so  much  lower  than  other 
children.  The  only  possible  explanation  which  occurs  to  us  is  in  the  method  of  giving 
and  scoring.  It  may  not  be  out  of  place  therefore  to  mention  just  how  we  do  our 
testing. 

All  of  the  tests  were  given  by  myself  and  one  assistant.  The  test  papers  were 
also  scored  by  us.  In  the  giving,  we  have  been  very  rigid  in  following  faithfully  the 
printed  directions,  never  varying  by  way  of  additional  explanation  in  the  slightest 
degree.  We  have  been  equally  exact  about  the  scoring,  although  there  is  less  tendency 
to  vary  procedure  here  than  in  the  giving.  Much  of  our  work  has  been  checked,  so 
that  we  are  sure  no  accidental  errors  have  crept  in. 

My  experience  in  training  teachers  to  give  standard  educational  tests  is  that 
there  is  an  almost  irresistible  tendency  to  help  a  little  more  than  the  directions  permit. 
A  teacher  may  read  over  the  directions  and  believe  that  a  slight  change  in  wording 
would  make  the  meaning  clearer,  or  think  that  a  certain  amount  of  coaching  in  taking 
such  a  type  of  test  is  legitimate.  Also,  during  the  test,  she  has  the  feeling  that  the 
directions  have  not  been  sufficiently  clear  and  she  adds  a  word.  All  of  this  is  possible 
and  likely  to  happen  in  more  cases  than  we  like  to  think.  The  result,  of  necessity,  is 
to  raise  the  pupils'  scores  and,  if  these  results  are  used  to  make  up  norms,  to  raise  the 
norms. 

If  I  am  right  in  this  explanation,  it  is  evident  that  a  single  set  of  norms  cannot  be 
of  universal  application.  Each  locality  will  have  to  establish  its  own  norms  imder  the 
conditions  under  which  it  proposes  to  administer  the  tests.  Granting  that  our  testing 
procedure  could  be  better  standardized,  that  alone  would  not  help  materially  unless  those 
who  administer  the  tests  could  be  made  to  adhere  more  carefully  to  the  same  procedure. 

With  the  rapid  increase  in  testing,  are  not  some  very  bad  and  misleading  results 
to  be  expected  unless  there  is  much  more  care  taken  to  understand  the  conditions 
under  which  the  testing  is  done? 

Warren  W.  Coxe 
Assistant  Director,  Vocation  Bureau,  Board  of  Education, 

Cincinnati,  Ohio 

The  Van  Wagenen  Reading  Scales  in  History,  General  Science,  and 
English  Literature 

Although  there  are  now  available  several  reading  scales  and  several  standardized 
or  diagnostic  tests  for  measuring  reading  ability,  little  attention  so  far  seems  to  have 
been  given  to  the  measurement  of  the  ability  to  read  and  comprehend  the  content  of 
any  particular  one  of  the  school  subjects.  The  present  series  of  reading  scales  is  an 
attempt  to  meet  just  this  need.  With  them  the  teacher  of  a  special  subject,  such  as 
history,  general  science,  or  English  literature,  will  be  able  to  determine  how  well  the 
individual  students  of  the  group  can  grasp  the  content  of  the  material  assigned  for 
reading  and  study.  Not  a  few  of  the  failures  to  do  successful  work  are  found  to  be  due 
to  inabiUty  to  read  and  comprehend  the  ideas  in  the  lessons  assigned.  With  the  use 
of  such  reading  scales  it  may  also  be  possible  to  determine  more  adequately  than 
can  be  done  at  the  present  time  the  abilities  of  students  to  take  up  certain  subjects  of 
study  rather  than  others. 
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Another  and  equally  important  value  of  the  scales  lies  in  the  possibility  of  deter- 
mining the  degree  of  difficulty  of  reading  material  that  may  safely  be  placed  in  the 
hands  of  students  of  various  degrees  of  capacity,  ability,  and  maturity  with  an  expecta- 
tion that  the  content  will  be  comprehended.  Few  indeed  are  the  textbooks  in  use  at 
the  present  time  that  are  written  consistently  within  the  range  of  comprehension  of 
the  students  for  whom  they  are  designed.  Nor  could  the  situation  very  well  be  other- 
wise in  the  absence  of  more  definite  models  for  each  particular  stage  of  achievement. 

No  less  important  but  less  evident  is  the  value  of  such  scales  in  making  possible  (1 ) 
relatively  accurate  comparisons  of  ability  in  reading  in  various  subjects;  (2)  relatively 
accurate  measurements  of  the  effects  of  increasing  the  student's  range  of  information 
in  a  subject  upon  his  ability  to  read  intelligently  in  that  subject;  and  (3)  relatively 
accurate  measurements  of  the  effect  of  different  methods  of  study  upon  the  ability  to 
read  independently  in  a  certain  subject. 

The  unit  of  measurement  in  these  scales  is  the  deciquartile  or  one- tenth  quartile. 
The  quartile  is  the  amount  by  which  two  exercises  must  differ  in  difficulty  in  order 
that  one  shall  be  done  with  the  same  degree  of  correctness  by  the  mid-pupil  in  a  nor- 
mally distributed  group  as  the  second  is  done  by  the  pupil  who  stands  at  the  top  of  the 
lower  quarter  of  the  group  or  at  the  top  of  the  lower  three-quarters  of  the  group.  The 
deciquartile,  or  one-tenth  quartile,  thus  represents  one-tenth  of  the  difference  in  read- 
ing abihty  between  the  median  pupil  and  either  the  twenty-five  or  seventy-five  per- 
centile pupil  in  a  normally  distributed  group  in  reading  ability  in  a  special  subject  like 
history.  Inasmuch  as  the  zero  point  in  reading  ability  has  not  yet  been  adequately 
determined,  an  arbitrary  zero  point  has  been  selected  which  lies  eighty  deciquartiles 
or  eight  quartiles  below  the  abihty  of  the  median  first-year  high-school  student  at 
the  end  of  the  year.  Although  it  will  not  yet  be  possible  to  say  that  one  student  has 
one  and  one-half  times  as  much  reading  abiUty  in  history  as  another  student  has,  or 
that  he  can  read  one  and  one-half  times  as  well  in  history  as  in  general  science,  never- 
theless one  can  say  that  one  student  or  one  group  has  made  one  and  one-half  times  as 
much  gain  as  another  student  or  group  of  students.  An  illustration  would  be  the  case 
of  one  group  making  a  gain  from  72  deciquartiles  up  to  80  deciquartiles,  while  a  second 
group  made  a  gain  from  72  deciquartiles  up  to  84  deciquartiles  during  the  same 
period. 

The  exercises  in  the  several  reading  scales  were  scaled  in  terms  of  the  quartile  by 
practically  the  same  method  as  used  by  the  author  in  making  his  American  history 
tests.  The  pcrcents  of  students  of  each  group  taking  the  original  tests — approximately 
750  in  grades  eight  to  twelve — who  did  each  exercise  correctly  were  found.  With  the 
use  of  the  table  devised  by  W.  F.  Sheppard,  these  percents  were  turned  into  quartile 
values.  The  quartile  values  for  the  different  grades  were  then  referred  to  the  median 
of  the  first-year  class,  which  as  stated  above,  was  placed  at  80  deciquartiles  above  an 
arbitrary  zero  point.  The  only  difference  in  method  lay  in  the  determination  of  the 
distances  between  the  group  medians.  In  this  study  the  differences  were  based  on  the 
averages  of  distances  for  each  exercise  instead  of  on  the  overlapping  of  the  groups 
upon  one  another's  medians,  as  the  former  method  seemed  to  give  a  more  adequate 
measure  of  the  grade  differences  for  the  reading  exercises. 

In  connection  with  the  derivation  of  these  scales  two  other  facts  should  be  noted. 
The  scales  are  purely  reading  scales.  No  writing  other  than  the  making  of  check  marks 
is  necessary.    Each  exercise,  of  which  there  are  fifteen  in  each  scale,  consists  of  a 
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carefully  selected  paragraph  with  a  list  of  from  four  to  six  statements  below  it.  These 
statements — which  for  the  eighth  grade  and  high-school  student  are  of  approximately 
equal  difficulty  within  any  one  set — either  contain  an  idea  that  is  expressed  in  the 
paragraph  in  different  words  or  that  can  be  derived  from  a  reading  of  the  paragraph, 
or  else  contain  an  idea  that  might  be  but  is  not  in  the  paragraph  or  derivable  from  it. 
The  student  has  merely  to  check  those  statements  which  contain  an  idea  that  is  to  be 
found  in  the  paragraph  or  that  can  be  inferred  from  it.  All  the  teacher  needs  to  do  in 
correcting  the  test  papers  is  simply  to  note  from  a  key  the  number  of  errors  made  in 
each  set  and  to  write  this  number  of  errors  in  a  special  form  provided  for  it  at  the  top 
of  the  front  page. 

Along  with  the  ease  with  which  the  exercises  may  be  scored  is  the  ease  with  which 
the  student's  score  in  terms  of  a  scale  value  may  be  calculated.  As  pointed  out  by 
Dr.  Truman  Lee  Kelley,  the  most  reliable  scale  score  for  an  individual  is  that  score 
where  the  amount  of  error  and  the  amount  of  correctness  are  the  same.  Although  the 
calculation  of  this  point  is  somewhat  involved,  the  score  may  be  arrived  at  in  a  very 
few  seconds  with  the  use  of  tables  recently  worked  out  for  this  purpose.  The  data  in 
the  original  tables  have  been  adapted  for  use  with  these  scales  so  that,  having  the 
number  of  errors  tabulated  in  the  form  provided  on  the  front  page  of  the  scale,  the 
student's  score  may  be  readily  determined  merely  by  consulting  two  short  keys  and 
making  one  simple  addition  and  one  simple  subtraction. 

From  having  the  scores  thus  expressed  in  terms  of  a  scale  unit,  several  advantages 
accrue.  Comparisons  of  achievement  in  terms  of  definite  amounts  may  be  made, 
a  process  that  cannot  be  done  with  accuracy  with  the  use  of  ordinary  standard  tests 
made  up  of  unsealed  data.  The  scores  made  by  students  on  one  scale  are  of  the  same 
magnitude  and  value  as  those  made  on  another  similar  scale,  even  though  the  starting 
and  ending  values  of  the  exercises  in  the  two  scales  differ.  This  is  a  feature  that  is 
possible  in  the  usual  scale  only  when  the  diflSculties  of  the  tasks  in  the  duplicate  tests 
are  identical — a  feature  that  is  not  only  diflScult  to  attain  but  also  one  seldom  achieved. 
From  the  foregoing  statements  it  is  apparent  that  this  series  of  scales  possesses  features 
that  should  characterize  every  educational  test  or  scale  of  this  type;  namely,  there  are 
duplicate  scales  for  each  of  the  subjects  so  that  accurate  comparisons  of  achievement 
may  be  made;  also  additional  duplicate  scales  can  be  developed  with  very  much  less 
work  than  the  two  original  scales  in  each  subject  required, 

M.  J.  Van  Wagenen 
University  of  Minnesota 


(E.  J.  AsHBAUGH,  Secretary  and  Editor) 


REPORT  ON  THE  SEVENTH  ANNUAL  MEETING  OF  THE  NATIONAL 
ASSOCIATION  OF  DIRECTORS  OF  EDUCATIONAL  RESEARCH 

Six  years  ago  at  Cincinnati  during  the  meeting  of  the  Department  of  Superinten- 
dence a  little  group  of  men,  engaged  in  the  relatively  new  field  of  educational  research 
in  public  schools,  met  for  a  round  table  discussion  of  the  problems  which  were  facing 
them.  Believing  that  an  organization  of  the  men  of  common  interests  in  this  field 
would  be  both  helpful  to  the  men  themselves  and  stimulating  to  the  country  at  large, 
they  formed  a  preliminary  organization  and  named  committees  to  draw  up  a  constitu- 
tion and  launch  the  movement. 

At  Detroit  the  following  year  this  initial  group  with  a  few  others  came  together 
for  a  dinner  and  an  evening  of  discussion.  The  next  year  (1917)  at  Kansas  City  a  half- 
day  session  public  program  was  offered  and  evoked  enough  interest  to  warrant  the 
preparation  of  a  yearbook,  which  was  published  by  the  National  Society  for  the  Study 
of  Education  as  its  Seventeenth  Yearbook,  Part  2.  The  reception  of  this  yearbook  on 
the  part  of  the  public  justified  the  effort  of  the  association  in  that  direction,  and  the 
growing  numbers  attending  the  public  programs  have  continued  to  testify  to  the 
quality  of  the  material  presented  upon  them.  ' 

At  the  Atlantic  City  meeting  three  years  ago  another  public  program  was  offered. 
Apparently  no  new  developments  came  about  at  this  meeting  except  that  a  new  secre- 
tary was  elected — George  Melcher  having  served  from  the  beginning  and  having  asked 
to  be  reUeved — and  the  first  provision  for  regular  annual  dues  was  made.  The  fact  is 
that  at  this  meeting  the  members  were  so  much  occupied  in  congratulating  themselves 
on  the  yearbook  (which  had  just  appeared)  that  new  ideas  were  not  forthcoming. 

Two  years  ago  the  members  of  the  association,  feeling  that  they  were  unable  at 
the  public  meetings  to  get  all  of  the  intimate  critical  give-and-take  upon  their  problems 
which  they  had  originally  expected,  provided  for  a  one-day  meeting  open  to  members 
only.    The  first  meeting  of  this  sort  was  held  at  Cleveland  last  year. 

The  second  annual  closed  meeting  was  held  Saturday,  February  26,  1921  in  Had- 
don  Hall  Hotel.    About  thirty  were  present,  and  the  meeting  was  thoroughly  informal. 

Dr.  McCall  reported  on  the  development  of  scale  construction  with  special 
reference  to  the  new  Thorndike-McCall  Reading  Scales.  He  called  attention  to  the 
fact  that  the  maker  of  an  educational  measurement  scale  might  employ  one  of  the 
following  five  methods:  (1)  percentile;  (2)  variability  of  adult  judgment;  (3)  varia- 
bility of  adult  performance;  (4)  age  scale  method;  (5)  variability  of  pupil  performance. 
He  presented  the  objections  to  each  of  these  methods  as  they  occurred  to  him  in  the 
making  of  his  reading  scales  for  elementary-school  pupils. 

The  objections  are  herewith  listed  practically  without  discussion,  being  numbered 
in  the  same  order  as  that  in  which  the  methods  are  named: 

(1)  Objections — (a)  varjdng  zero  point  and  (b)  unequal  units. 
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(2)  and  (3)  Inappropriate  for  an  elementary  reading  scale. 

(4)  (a)  Inequality  of  units;  (b)  educational  growth  not  equal  for  different  years; 
result  sometimes  negative. 

(5)  (a)  Usually  involves  an  attempt  to  locate  zero  point,  but  no  agreement  or 
means  of  reaching  agreement  in  finding  it  or  determining  what  zero  ability  is; 
(b)  yields  relatively  ephemeral  results;  and  (c)  in  order  to  produce  an  even 
step  scale,  a  large  proportion  of  material  must  be  thrown  away. 

Therefore,  there  is  need  for  a  method  that  will  have  units  comparable  within  the  scale 
itself;  units  comparable  with  units  of  other  scales;  and  a  constant  reference  point.  His 
solution  of  these  problems  is  given  in  the  latest  issue  of  the  Teachers'  College  Record. 

Miss  Race,  psychological  examiner  for  the  Kansas  City,  Missouri,  public  schools, 
next  presented  some  experimental  data  on  intelligence  scores  and  silent  reading  scores. 

Saturday  afternoon  Dr.  Rugg  reported  for  the  subcommittee  on  standardization 
of  statistical  terms,  and  suggested  that  this  association  should  not  act  until  the  com- 
mittee of  the  National  Research  Council  which  is  working  on  the  same  problem  shall 
have  made  its  report. 

Dr.  Ashbaugh  reported  for  the  subcommittee  on  child  accounting;  and  Professor 
Courtis  reported  for  the  general  committee  on  standardization.  Courtis  showed  that 
the  returns  from  his  questionnaire  were  distinguished  rather  for  their  differences  than 
for  their  unanimity  of  opinion,  though  the  membership  tended  to  divide  into  two  fairly 
definite  groups.  He  recommended  that  a  decision  on  policy  be  based  upon  the  discus- 
sion by  the  members  present  rather  than  upon  the  majority  vote  he  had  obtained  on 
the  propositions  submitted. 

A  committee,  of  which  Courtis  was  chairman,  was  therefore  appointed  to  report 
to  the  association  on  Thursday. 

Two  actions  were  taken,  however,  of  which  our  members  should  take  special  note: 

1.  Motion  carried  that  the  reliability  of  a  test  shall  be  understood  to  be  the  degree 
of  correspondence  between  successive  scores  of  the  same  individuals  on  the  same  test. 

2.  Motion  carried  that  in  reference  to  correlation,  members  of  the  association  use 
the  term  "Product  Moment  Method"  instead  of  the  term  "Pearson  Method." 

On  Thursday  the  open  meeting  of  the  association  was  held.  An  account  of  it  is 
given  below.  Because  large  numbers  of  the  superintendents  as  well  as  some  of  our 
members  had  to  leave  Atlantic  City  during  the  afternoon  or  early  evening,  it  was 
decided  to  change  our  annual  dinner  to  a  noon  luncheon.  When  President  Haggerty 
asked  for  roll  call,'  three  honorary  members  (J.  McKeen  Cattell,  E.  L.  Thomdike, 
and  J.  M.  Rice)  and  thirty  active  members  responded  as  follows: 

Active  Members 
S.  A.  Courtis         .  Arthur  S.  Otis  Ira  J.  Bright 

B.  T.  Baldwin  J.  Freeman  Guy  Elmer  K.  Sexton 

G.  M.  Whipple  R.  L.  Morton  H.  A.  Greene 

Laura  Zirbes  H.  C.  Daley  Thomas  J.  Kirby 

Edna  Gordon  J.  Cayce  Morrison  Charles  Fordyce 

P.  C.  Packer  W.  W.  Coxe  Emma  M.  Brown 

M.  E.  Haggerty  M.  R.  Trabue  Harriet  M.  Barthelmess 

E.  J.  Ashbaugh  George  Melcher  B.  R.  Buckingham 

A.  B.  Wight  Carter  Alexander  Henrietta  V.  Race 

L.  A.  WUliams  W.  J.  Osbum  Harold  O.  Rugg 
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Due  to  the  limited  time  at  our  disposal,  necessary  items  of  business  were  cared 
for  at  intervals  during  the  progress  of  the  luncheon.  The  president  first  announced  the 
names  of  the  three  men  who  were  elected  to  honorary  membership  this  year.  These 
were:  Dr.  Lotus  D.  Coffman,  Dr.  Clark  Wissler,  and  Dr.  J.  McKeen  Cattell.  Dr. 
Cattell  was  the  only  one  of  these  three  men  who  were  able  to  be  with  us  at  the  luncheon. 

The  secretary  also  announced  that  during  the  past  year  there  had  been  twenty- 
three  members  added  to  the  active  roll.  The  complete  membership  list  will  appear  in 
the  next  issue  of  the  Journal. 

A  communication  from  Dr.  L.  P.  Ayres,  a  charter  member  of  our  association,  con- 
taining his  resignation  from  membership  was  read.  The  association  voted  to  accept 
his  resignation  with  regret,  and  elected  him  immediately  to  honorary  membership. 

The  committee  appointed  on  Saturday  to  revise  the  membership  article  of  the 
constitution  reported,  and  after  a  slight  modification  had  been  made,  the  report  was 
accepted.    The  new  article  will  appear  in  this  department  in  the  next  issue. 

The  committee  on  standardization  rendered  a  report  which  the  association  adopted 
and  ordered  printed  in  the  Journal  at  an  early  date.  Action  was  also  taken  requiring 
that  the  report  on  chUd  accounting  which  was  read  on  Saturday  should  be  sent  out  to 
the  members  for  vote,  and  the  committee  on  standardization  was  given  discretionary 
power  to  print  this  report  also. 

The  president's  annual  address  confined  itself  largely  to  the  progress  in  intelligence 
testing.  It  was  received  with  so  much  favor  that  the  association  requested  that  it  be 
printed  in  the  Journal  for  the  benefit  of  our  entire  membership. 

The  following  were  elected  for  the  ensuing  year: 

President — Dr.  H.  0.  Rugg,  Educational  Psychologist,  Lincoln  School,  Teachers 
College,  Columbia  University,  New  York  City. 

Vice-President — Dr. Virgil  E.  Dickson,  Director  of  Bureau  of  Educational  Research, 
Oakland  and  Berkeley,  California. 

Secretary-Treasurer — Dr.  E.  J.  Ashbaugh,  Director  of  Bureau  of  Educational  Ser- 
vice, State  University  of  Iowa,  Iowa  City,  Iowa. 


(The  following  write-up  of  the  Thursday  program  was  contributed  by  our  accom- 
modating editor,  B.  R.  Buckingham. — E.  J.  A.) 


After  dragging  through  the  intervening  days  and  conscientiously  exposing  our- 
selves to  the  warmed-over  program  materials  offered  at  other  meetings,  it  was  a  rehef 
to  attend  our  Thursday  meeting.  Nor  were  we  alone  in  our  notion.  Although  Presi- 
dent Haggery  had  scheduled  the  meeting  for  the  unusually  early  hour  of  nine  o'clock, 
the  hall  was  fairly  well  filled  when  the  first  paper  was  announced,  and  by  ten  o'clock 
we  were  pla5dng  to  standing  room  only. 

The  program  moved  forward  with  clock-like  precision.  Every  person  who  was 
scheduled  for  an  address  was  present.  Each  paper  was  given  precisely  in  the  order  of 
its  appearance  on  the  printed  program. 

Mr.  Buckingham's  "One  Hundred  Percent  Promotion'l^owed  how  actual  promo- 
tion rates  of  95  percent  were  secured  in  two  cities  for  three  successive  semesters  without 
detriment  to  grade  standards.  Mr.  Fordyce  presented  a  capital  paper  on  the  classifica- 
tion of  children  through  the  use  of  intelligence  tests.  Mr.  Whipple  let  us  into  some  of 
the  mysteries  in  the  derivation  of  the  National  Intelligence  Tests.   His  obscrvatipne  on 
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the  value  of  these  tests  and  the  uses  that  may  be  made  of  them  were  well  received. 
Mr.  Bright  showed  some  of  the  uses  he  has  been  making  of  intelligence  examinations 
with  high-school  freshmen.  His  results  were  related  to  the  success  of  pupils  in  several 
school  subjects.  Mr.  Thomdike  distributed  copies  of  his  Intelligence  Examination 
and  gave  a  highly  suggestive  talk  on  the  testing  of  high-school  graduates,  using  this 
examination  as  his  text.  This  ended  the  morning  program.  President  Haggerty  had 
planned  to  close  the  session  at  1 1 :45  and  the  smooth-running  machine  which  he  had 
set  up  came  to  a  halt  exactly  as  scheduled. 

By  telescoping  business  with  eating  we  were  able  to  accomplish  a  great  deal  of 
both.  The  afternoon  program  was  to  begin  at  two  o'clock  in  another  building.  The 
luncheon,  however,  lasted  until  nearly  two-thirty.  The  president,  not  being  endowed 
with  the  property  of  ubiquity,  dispatched  Mr.  Fordyce  to  open  the  meeting  and  intro- 
duce Mr.  Gray — W.  S.  of  Chicago — to  the  expectant  audience.  Any  expectations 
which  the  audience  may  have  entertained  were  amply  justified.  For  concrete,  helpful 
data  such  as  could  be  used  in  the  classroom,  Mr.  Gray's  paper  on  "Diagnostic  and 
Remedial  Steps  in  Reading"  was  only  rivaled  by  Mr.  Horn's  on  "A  Constructive  Pro- 
gram in  the  Development  of  Ability  to  Read  Complicated  Materials."  Indeed,  so  rich 
were  these  papers  in  what  Horn  calls  "factual"  material  that  nothing  short  of  the  care- 
ful reading  of  their  printed  reports  will  be  fully  satisfactory.  It  is  a  tribute  to  these 
papers  that  the  audience  was  frantically  taking  notes  while  the  speakers  were  delivering 
them. 

Mr.  Rugg  gave  a  paper  on  "The  Curriculum  in  Economic  and  Social  Studies." 
In  this  paper  he  maintained  that  teachers  get  little  further  than  the  textbook  in  securing 
materials  for  instruction,  that  textbooks  were  largely  written  by  college  men,  and  that 
the  real  sources  from  which  the  curriculum  should  be  derived  are  the  needs  and  uses 
of  society.  Mr.  Alexander  gave  a  highly  interesting  sketch  of  some  of  the  factors  in- 
fluencing the  successful  presentation  to  the  public  of  educational  measurements.  The 
"fact  basis"  of  this  discussion  was  in  part  the  material  which  the  State  Department  of 
Education  of  Wisconsin  has  gathered  concerning  publicity  campaigns.  He  gave  many 
important  suggestions  and  cautions  for  publicity  work. 

Secretary  Ashbaugh  at  this  point  tore  himself  away  from  the  scribbling  on  which 
he  had  been  mysteriously  engaged  and  presented  a  paper  on  "The  Measurement  of 
Language."  He  reviewed  the  development  of  the  measurement  of  composition  and 
language  from  the  very  general  scales  of  the  Hillegas  family  through  the  more 
analytic  instruments  of  Ballou,  Trabue,  and  Green  to  those  of  Starch,  Charters,  and 
Kirby.  He  asserted  that  this  analysis  should  go  further  and  that  instruments  which 
get  at  specific  details  are  the  only  ones  which  can  be  relied  upon  to  reveal  rather  than 
conceal  the  defects  of  pupils  in  language. 

The  valedictory  was  pronounced  by  Mr.  Courtis  who  presented  "Research  as  a 
Distinct  Function  of  Supervision."  He  showed  clearly  the  truly  remarkable  type 
of  organization  which  has  been  developed  at  Detroit.  It  is  quite  impossible  within 
the  limits  of  this  sketch  to  say  anything  adequate  concerning  it.  We  can  only  hope 
that  Mr.  Courtis  will  giv^^mself  full  scope  in  telling  us  about  it  when  he  submits  his 
program  article  for  publication. 

We  cannot  conclude  our  account  of  the  meetings  of  the  association  without 
an  expression  of  appreciation  to  President  Haggerty.  The  members  of  the  Research 
Association  and  the  public  feel  that  an  exceptionally  scholarly  and  helpful  program 
was  presented  as  the  result  of  his  efforts. 
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Aims  precede  the  curriculum.  Alike  in  the  organized  writings 
of  educators  and  in  the  changing  conceptions  of  unorganized  edu- 
cational opinion,  fundamental  changes  in  the  curriculum  occur 
only  after  fundamental  modifications  of  the  aims  of  education 
have  been  discovered.  Among  the  writers,  Plato  described  the 
qualities  of  the  perfect  warrior  guardian  of  the  state  before  deter- 
mining upon  his  education;  Comenius  presents  the  aims  of  virtue, 
piety,  and  learning  before  prescribing  the  curriculums  of  his  sys- 
tems of  education;  and  Rousseau  justifies  his  course  of  study  by 
appeal  to  certain  pre-formed  assumptions  concerning  "the  nature" 
of  the  child.  Likewise,  in  the  fluid  movement  of  thought  of  the 
present  generation  when  the  curriculum  of  our  times  is  in  the 
making,  we  find  that  only  after  such  aims  as  social  efl&ciency  have 
been  subjected  to  prolonged  discussion,  do  changes  in  the  curricu- 
lum begin  to  occur. 

This  precedence  of  aims  over  subject  matter  is  a  necessity  for 
purposes  of  selection  and  use.  Because  the  information  which 
youth  inherits  is  beyond  his  powers  of  complete  assimilation,  selec- 
tion must  be  made  and  a  line  must  be  drawn  between  the  more 
useful  and  the  less  useful.  And  since  selection  is  based  upon  value, 
educational  aims  must  first  be  formulated.  Moreover,  since  the 
functions  of  subject  matter  must  be  taught  (for  to  present  facts 
without  an  acquaintance  with  the  uses  to  which  they  are  to  be 
put  is  futile)  in  the  last  analysis  the  use  of  any  individual  fact  must 
be  derived  from  the  central  aims  of  the  whole  system  of  education. 
So,  for  both  selection  and  use  the  aims  of  education  must  precede 
the,  construction  of  the  curriculum. 
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But  though  in  all  the  educational  classics,  the  writers  have 
begun  with  the  statement  of  aim,  none  has  been  able  logically  to 
derive  an  adequate  curriculum  from  his  aim.  In  every  case  there 
has  been  a  mental  leap  from  the  aim  to  the  subject  matter,  with  no 
adequate  principles  to  guide  in  the  selection  of  material.  This 
may  seem  to  be  a  sweeping  statement  but  a  few  illustrations  will 
demonstrate  its  accuracy.  In  Plato's  Republic,  the  author  states 
his  aim  as  follows:  ''Then  in  our  judgment  the  man  whose  natural 
gifts  promise  to  make  him  a  perfect  guardian  of  the  state  will  be 
philosophical,  high-spirited,  swift-footed,  and  strong."  Proceed- 
ing he  says,  "This  then  will  be  the  original  character  of  our  guard- 
ians. But  in  what  way  shall  we  rear  and  educate  them?"  And 
answers  his  query  as  follows:  "What  then  is  the  education  to  be? 
Perhaps  we  could  hardly  find  a  better  than  that  which  the  expe- 
rience of  the  past  has  already  discovered,  which  consists,  I  believe, 
in  gymnastics  for  the  body,  and  music  for  the  mind."  He  then 
proceeds  to  analyze  gymnastics  and  music  and  argues  for  the  in- 
clusion of  narratives,  fables,  and  poetry  in  his  course  in  music, 
which  present  certain  proper  ideals  in  the  proper  form,  and  of  the 
proper  types  of  melodies  and  songs.  In  his  course  in  gymnastics 
he  mentions  little  of  the  content  but  devotes  his  attention  to  the 
ideals  of  temperance,  hardness,  and  health  of  body. 

But  this  line  of  reasoning  leaves  much  to  be  settled.  Can  the 
philosophical  disposition  be  best  trained  through  music?  What 
parts  of  censored  literature  are  to  be  selected?  What  gymnastic 
exercises  are  to  be  included  in  the  curriculum?  When  the  warrior 
has  exercised  in  the  gymnasium  is  he  adequately  trained  for  war 
or  does  he  need  some  additional  curriculum  not  mentioned  by 
Plato? 

This  curriculum  is  not  an  adequate  system  of  instruction  for 
warriors.  Within  the  last  few  years  we  have  seen  "a  million  men 
spring  to  arms,"  "high-spirited  and  strong,"  but  they  were  not 
soldiers.  Before  they  became  the  perfect  guardians  of  the  state 
their  curriculum  came  to  include  much  besides  fables  and  poetry, 
melodies  and  songs.  They  had  to  learn  to  march,  to  shoot,  to 
thrust  with  the  bayonet,  to  fight  in  aeroplanes,  and  to  sail  the 
seas.  Nor  for  the  warriors  of  ancient  Athens,  who  needed  much 
specific  training  in  the  field  and  camp  before  they  could  perform 
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the  acts  of  protection  or  aggression  mentioned  incidentally  in  the 
arguments  of  the  Republic,  was  Plato's  curriculum  adequate. 

The  aims  and  curriculums  of  Comenius  present  the  same  in- 
sufficiency. This  great  educator  assumes  the  aims  of  education 
to  be  to  bring  to  maturity  the  seeds  of  learning,  virtue,  and  piety 
implanted  within  us  by  nature.  He  then  outlines  his  course  for 
the  vernacular  school  as  follows  (after  Quick) :  *Tn  this  school  the 
children  should  learn — first,  to  read  and  write  the  mother-tongue 
well,  both  with  writing  and  printing  letters;  second,  to  compose 
grammatically;  third,  to  cipher;  fourth,  to  measure  and  weigh; 
fifth,  to  sing,  at  first  popular  airs,  then  from  music;  sixth,  to  say 
by  heart  sacred  psalms  and  hymns;  seventh,  catechism,  Bible 
history,  and  texts;  eighth,  moral  rules  with  examples;  ninth, 
economics  and  politics,  as  far  as  they  could  be  understood;  tenth, 
general  history  of  the  world ;  eleventh,  figure  of  the  earth  and  mo- 
tion of  the  stars,  etc.,  physics  and  geography,  especially  of  native 
land;  twelfth,  general  knowledge  of  arts  and  handicrafts." 

Comenius  sets  up  a  threefold  aim — learning,  virtue,  and  piety. 
If  we  consider  learning  first,  and  ask  whether  it  is  possible  to  learn 
everything,  the  answer  must  be  negative.  Even  though  the  Orbis 
Pictus  was  supposed  to  be  a  compendium  of  all  knowledge,  the 
compiler  selected  a  few  facts  from  the  total  mass.  But  when  we 
ask  for  the  basis  of  selection  of  facts  no  answer  can  be  given.  So 
far  as  the  aim  of  learning  is  concerned  with  the  selection  it  provides 
no  criterion.  Learning  is  learning  and  one  fact  is  as  good  as  an- 
other. If,  however,  we  say  that  virtue  and  piety  are  the  subsidi- 
ary aims  which  determine  what  facts  should  be  learned  we  are 
still  without  a  basis  of  selection.  Will  ciphering,  or  singing,  or 
economics  assist  in  any  peculiarly  valuable  way  to  promote  these 
two  ends?  Or,  to  carry  the  question  further,  what  details  of  cipher- 
ing or  economics  will  be  most  valuable  in  promoting  virtue  and 
piety?  None,  since  one  is  as  virtuous  as  another.  Obviously, 
subject  matter  cannot  be  derived  from  learning  of  virtue  and  piety. 

The  impossibility  of  deriving  subject  matter  from  these  aims  is 
due  to  the  fact  that  they  are  ideals  isolated  from  activities,  A 
virtuous  carpenter  does  not  perform  the  same  actions,  nor  meet 
the  same  problems  as  a  virtuous  cook.  A  pious  blacksmith  re- 
ceives a  different  education  from  that  of  a  pious  doctor.  A  vir- 
tuous and  pious  Chinaman  thinks  and  acts  on  different  matters 
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from  those  which  engage  the  attention  of  a  virtuous  and  pious 
American.  The  ideals  are  the  same;  the  lives  are  widely  different. 
It  would  be  futile  to  teach  a  Chinaman  the  same  curriculum  as  an 
American  unless  the  intention  were  to  Americanize  him. 

The  curriculum  is  derived  from  both  ideals  and  activities.  Vir- 
tue, swift-footedness,  piety,  or  social  efficiency  must  be  set  up  in 
a  system  of  education;  but  in  order  to  select  the  material  to  which 
these  shall  apply  it  is  absolutely  essential  for  the  teacher  to  know 
the  activities,  problems,  thoughts,  or  needs  in  connection  with 
which  these  ideals  are  to  operate. 

Plato  had  a  golden  opportunity  to  set  a  new  style  in  curriculum 
construction  when  he  posited  the  perfect  warrior  as  his  ideal.  If, 
instead  of  resting  content  with  an  enumeration  of  his  qualities, 
he  had  analyzed  the  duties  of  the  soldier,  made  what  we  call  a  job 
analysis,  and  had  decided  to  teach  swift-footedness,  strength, 
high  spirit,  and  the  philosophic  mind  through  these  activities,  he 
would  have  most  profoundly  influenced  the  education  of  two 
thousand  years.  But  when  he  had  stated  his  aim,  he  slipped  back 
into  the  rut  of  the  traditional  subjects  of  his  day  as  the  best  means 
of  developing  his  aims.  If,  in  like  manner,  Comenius  had  inquired 
into  the  activities  of  the  French  or  English  citizenry,  had  found 
out  the  important  daily  problems  they  had  to  meet  and  then  had 
sought  to  make  them  virtuous  and  pious  in  their  performance  of 
these,  he  would  have  had  a  curriculum  of  demonstrable  validity. 
He  would  then  have  known  what  ciphering,  or  economics,  or  polit- 
ical science,  what  music,  sacred  songs,  and  Biblical  passages  to 
learn.  In  other  words,  he  would  have  been  able  to  determine  not 
only  what  subjects  but  what  parts  of  subjects  to  include  in  his 
curriculum. 

Ideals  are  both  goals  and  standards.  As  goals,  good  taste, 
virtue,  health,  eloquence,  and  completeness  of  life  are  expressions 
of  valuable  ends  for  which  men  reach  and  whose  attainment  spells 
satisfaction.  Discover  the  ideals  of  a  nation  and  the  trend  of  its 
action  is  known.  As  standards,  ideals  are  arbiters  of  actions.  One 
action  may  be  discarded  because  it  does  not  promote  the  ideals, 
while  another  may  be  accepted  or  modified  because  its  perfor- 
mance leads  toward  the  goals.  But  no  man  who  sets  ideals  as 
goals  is  able  to  build  his  life  in  a  vacuum  and  order  his  actions  to 
suit  his  plans.    He  is  born  into  a  social  group  in  situations  over 
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which  he  has  no  original  control.  He  is  confronted  by  the  actions 
of  other  men  actuated  by  different  ideals.  Thrown  into  one  situa- 
tion he  develops  a  set  of  actions  different  from  those  he  would 
have  had  in  another.  With  both  his  situation  and  his  ideals  in 
mind  he  is  compelled  to  perform  actions  whose  character  is  de- 
termined by  both  the  ideals  and  the  situation.  Instead  of  pos- 
sessing ideals  and  inventing  a  situation  which  will  further  them,  it 
is  more  nearly  accurate  to  say  that  he  starts  with  situations  and 
modifies  them  so  as  to  realize  his  ideals  as  fully  as  circumstances 
will  permit. 

For  this  reason  the  curriculum  by  which  he  is  trained  to  per- 
form the  important  activities  of  the  group  in  accordance  with  the 
highest  ideals  is  necessarily  based  upon  both  activities  and  ideals. 
And  obviously  any  aim  of  education  expressed  only  in  terms  of 
ideals  must  fail  to  function. 

Today  the  same  procedure  is  necessary  if  the  curriculum  is  to 
be  modified  intelligently.  We  suffer  from  the  failure  to  distinguish 
between  ideals  and  activities  in  the  current  aim  of  social  efficiency. 
On  some  occasions  we  think  of  it  as  social  efficiency,  as  an  ideal  in 
the  sense  that  ideals  of  social  service  are  advocated.  But  on  other 
occasions  we  think  of  the  activities  carried  on  by  those  who  are 
socially  efficient,  such  activities  as  voting,  beautification  of  the  city, 
and  the  observance  of  community  health  regulations.  And  the 
result  has  been  that  only  spasmodically  and  incompletely  have  we 
been  able  to  modify  the  curriculum.  What  should  be  done  by 
those  who  advocate  social  efficiency  as  the  aim  of  education  is  to 
determine,  first,  the  ideals  of  socially  efficient  individuals;  second, 
the  fundamental  physical  and  mental  activities  carried  on  by 
people  in  the  United  States;  and  third,  by  a  process  of  laborious 
analysis  to  discover  exactly  what  important  specific  activities 
shall  be  taught  and  what  ideals  shall  control  in  the  performance 
of  each.  Until  the  objectives  of  education  are  broken  up  into 
these  two  elements  it  will  be  impossible  to  make  an  adequate 
reorganization. 


AN  EXPERIMENT  IN  PROMOTION* 

B.  R.  Buckingham 
University  of  Illinois 

In  the  fall  of  1918  the  influenza  epidemic  badly  disorganized 
the  schools.  It  became  evident  that  unless  the  usual  exactions 
with  reference  to  promotion  were  mitigated  an  unusually  large 
number  of  children  would  fail  of  advancement.  Perhaps  because 
of  this  fact,  the  superintendents  at  Springfield,  Illinois,  and 
Decatur,  Illinois,  were  more  hospitable  than  would  ordinarily 
have  been  the  case  to  a  proposal  whose  purpose  was  to  increase 
the  promotion  rate. 

The  plan  was  simplicity  itself.*  It  contemplated  that  each 
teacher  toward  the  close  of  the  semester  should  make  the  usual 
lists  of  pupils  recommended  for  promotion  and  for  failure;  but 
that  the  pupils  recommended  for  failure  should  be  advanced  to 
the  next  higher  grade  along  with  the  pupils  whose  title  to  the 
next  higher  grade  was  clear.  The  plan  further  contemplated 
that  the  pupils  who  were  thus  advanced  despite  the  teachers' 
recommendations  for  failure  should  be  carried  in  the  higher  grade 
on  probation  and  should  be  subjected  to  a  regimen  carefully 
devised  and  frequently  checked  up  with  a  view  to  stimulating 
the  pupils,  the  parents,  and  the  teachers  to  increased  effort. 

This  arrangement  did  not,  however,  contemplate  100  percent 
promotion.  The  pupils  who  were  advanced  on  probation  were 
not  regarded  as  officially  promoted  until,  as  a  result  of  the  efforts 
made  during  the  trial  period,  they  had  given  evidence  satisfactory 
to  the  teacher  and  the  supervising  officials  of  ability  to  maintain 
themselves  and  to  profit  by  the  work  of  the  higher  grade.  Only 
under  these  circumstances  was  the  promotion  actually  con- 
summated. 

The  probationary  period  began  with  the  first  day  of  the  new 
semester  and  lasted  six  weeks.  During  this  period  the  receiving 
teacher  kept  for  each  probationary  pupil  a  card  on  which  was 

^  A  paper  presented  at  the  meeting  of  the  National  Association  of  Directors  of 
Educational  Research  at  Atlantic  City,  N.  J.,  March  3,  1921. 

*  It  has  been  worked  out  in  detail  with  experimental  data  by  Mr.  H.  T.  McKinney, 
a  graduate  student  in  education  at  the  University  of  Illinois. 
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shown  in  the  first  place  the  record  of  the  pupil  in  the  previous 
semester  and  grade — i.e.,  the  record  which  caused  the  sending 
teacher  to  recommend  him  for  failure.  In  the  second  place,  the 
receiving  teacher  indicated  for  each  of  the  major  subjects  and 
for  each  week  of  the  probationary  period  whether  the  pupil's 
work  was  satisfactory  or  unsatisfactory.  Thus,  at  the  end  of 
the  first  week,  the  teacher  indicated  whether  or  not  the  reading 
had  been  satisfactory;  whether  or  not  the  arithmetic  had  been 
satisfactory ;  and  the  same  information  as  to  language,  geography, 
history,  and  spelling,  so  far  as  these  subjects  applied.  The  teacher 
also  entered  her  best  judgment  as  to  whether  the  work  as  a 
whole — i.e.,  in  all  the  subjects  considered  together — was  satis- 
factory or  unsatisfactory.  Similar  entries  were  made  for  the 
second,  third,  and  successive  weeks.  At  the  end  of  the  six-week 
period  the  measure  of  success  or  failure  was  fairly  detailed. 

In  the  third  place,  the  receiving  teacher  recorded  the  efforts 
which  she  made  to  assist  the  pupil  in  maintaining  himself  in  the 
higher  grade.  No  little  preparatory  work  was  done  in  an  experi- 
mental way  in  setting  up  this  part  of  the  record.  A  number  of 
plans  and  devices  for  assisting  pupils  which  had  been  found  to 
work  out  in  similar  cases  were  considered.  As  a  result  we  dis- 
tinguished eight  devices,  and  on  these  we  asked  the  teacher  to 
report  which  ones  she  used  in  the  first  week  of  the  probationary 
period;  which  in  the  second  week;  which  in  the  third  week,  and 
so  on.  The  eight  devices  set  up  on  the  cards  were:  (1)  visits  to 
pupil's  home;  (2)  other  interviews  with  parents;  (3)  help  outside 
of  school  hours;  (4)  varying  the  course  of  study;  (5)  varying  the 
teaching  method;  (6)  using  pupil  cooperation;  (7)  daily  reports 
to  parents;  (8)  sending  home  pupil's  work.  The  teachers  were 
furnished  with  considerable  detail  as  to  the  use  and  proper  value 
of  each  of  these  devices.  Most  of  the  devices,  therefore,  had  a 
broader  meaning  to  the  people  who  were  to  use  them  than  the 
mere  naming  of  them  implies. 

For  example,  the  device  which  I  have  called,  "Daily  reports 
to  parents"  was  administered  in  two  subordinate  operations.  It 
involved  the  provision  of  a  small  notebook  of  uniform  size  for  all 
pupils  concerned.  It  contemplated  the  entry  by  the  teacher  at 
the  close  of  each  day  of  an  estimate  of  the  work  of  the  pupil  lor 
that  day.    The  book  containing  this  estimate,  together  with  any 
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recommendations  which  the  teacher  might  find  advisable,  was 
signed  by  the  teacher  and  carried  home  by  the  pupil  in  the  after- 
noon. As  evidence  that  the  parent  had  seen  the  report,  the  pupil 
was  required  to  return  the  book  the  next  morning  with  his  parent's 
signature.  In  order  to  prevent  the  forging  of  signatures,  teachers 
were  advised  to  obtain  on  the  first  day  of  the  probationary  period 
bona  fide  signatures  of  all  parents  of  probationary  pupils.  At  this 
point  I  am  tempted  to  digress  to  give  evidence  in  support  of  the 
efficacy  of  this  device.  Both  as  a  school  man  and  as  a  parent,  I 
know  positively  that  even  progressive  schools  are  not  realizing  the 
tremendous  possibility  of  systematic  cooperation  in  the  home. 
Even  the  best  homes  are  surprisingly  ignorant  of  what  goes  on  in 
the  school  and  of  what  pupils  are  expected  to  do.,  The  steady 
pressure  and  sustaining  influence  of  the  home  which  is  kept 
constantly  and  authoritatively  informed  is  little  realized  by 
school  people. 

Finally,  at  the  conclusion  of  the  six-week  probationary  period 
the  teacher  was  required  to  enter  on  the  probationary  card  of 
each  pupil  her  recommendation  as  to  the  retention  of  the  pupil 
in  the  grade  to  which  he  had  been  advanced  on  probation.  Provi- 
sion was  also  made  for  the  recommendation  of  the  building 
principal  on  each  card  and  for  final  action  of  the  superintendent. 

During  the  course  of  the  probationary  period  arrangements 
were  made  for  supervising  the  efforts  of  the  teacher.  The  pupil's 
individual  card  containing,  as  we  have  said,  the  detailed  scholastic 
standing  and  the  notations  as  to  devices  used  to  aid  the  pupil, 
was  kept  filed  in  the  office  of  the  principal  and  was  made  available 
to  supervisors  and  to  the  superintendent.  In  other  words,  the 
te^acher  did  not  retain  the  card  and  offer  it  for  inspection  when 
called  for,  but  she  kept  it  permanently  filed  in  the  principal's 
office,  except  when  she  needed  it  for  the  purpose  of  making 
entries  upon  it. 

Let  us  now  return  to  conditions  as  they  were  toward  the  close 
of  the  first  semester  of  1918-1919.  The  influenza  and  the  Christ- 
mas vacation  had  just  passed,  and  each  had  done  its  worst  for 
the  schools.  Teachers  at  Decatur  and  Springfield,  ignorant  of 
the  impending  experiment  in  total  promotion,  were  making  up 
their  lists  of  pupils  recommended  for  failure.  It  was  a  long  list 
aggregating  at  these  two  cities  1,276  pupils,  exclusive  of  those  in 
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the  low  first  grade  and  the  high  eighth  grade.  After  these  lists 
had  been  made  out  and  submitted  to  the  superintendent,  it  was 
announced  that  all  these  children  would  be  advanced  to  the 
grade  to  which  they  would  have  been  promoted  if  they  had  not 
been  recommended  for  failure.  Accordingly,  all  the  classes, 
except  those  in  the  grades  mentioned,  moved  forward  en  bloc, 
each  with  a  little  group  of  probationers. 

Observe  that  we  have  here  a  new  emphasis  in  connection 
with  the  administrative  problem  of  promotion.  According  to 
the  plan  which  we  are  accustomed  to  follow,  attention  is  centered 
upon  the  sending  teacher.  The  promotion  rate  for  each  class  is 
a  matter  of  concern,  but  it  has  reference  to  the  class  as  constituted 
at  the  close  of  the  previous  semester.  Little  heed  is  given  to  the 
receiving  teacher.  Very  few  principals  or  superintendents  make 
her  activities  with  reference  to  promoted  pupils  matters  of  record. 
Realizing  no  responsibility  in  connection  with  promotion,  she  not 
infrequently  devotes  some  attention  to  trimming  up  the  class 
which  she  has  received.  Pupils,  if  they  are  "difficult"  and  if  they 
are  old  enough,  drop  out  of  school.  We  do  not  assert  that  the 
receiving  teacher  takes  the  initiative  in  inducing  them  to  do  this; 
but  the  measures  she  adopts  to  retain  an  undesirable  pupil  who 
is  minded  to  leave  school  are  likely  to  be  feeble  and  ineffective. 
Again,  the  process  of  trimming  up  the  class  is  effected  by  securing 
an  occasionar  transfer  of  a  pupil  to  some  other  class  of  the  same 
grade  either  in  the  same  building  or  elsewhere.  Not  infrequently 
the  receiving  teacher  reports  certain  pupils  for  demotion,  assert- 
ing that  they  have  not  been  sufficiently  well  prepared  and  leaving 
it  to  be  inferred  that  their  promotion  was  secured  through  the 
undue  liberality  of  the  sending  teacher.  In  fact,  the  sending 
teacher  is  often  freely  criticized  by  the  receiving  teacher.  Not 
infrequently  this  criticism  is  outspoken  and  unprofessional. 

When,  however,  the  sending  teacher  has  nothing  to  say  about 
promotion  further  than  to  recommend  probationary  pupils;  when 
promotion  rates  are  made  up  on  the  basis  of  the  number  of 
children  who  maintain  themselves  in  the  grade  to  which  they 
have  been  advanced;  when,  in  short,  it  is  the  receiving  teacher 
upon  whom  the  spot  light  is  turned  and  whose  reputation  is 
involved,  we  have  automatically  provided  not  only  for  a  new 
emphasis  but  also  for  a  new  result. 
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At  this  point  we  should  like  to  raise  the  question  of  the 
propriety  of  deciding  upon  the  promotion  or  failure  of  a  pupil 
in  this  way.  The  usual  criterion  of  promotion  is  ability  to  "pass" 
the  work  of  the  previous  grade.  In  other  words,  promotion  to  a 
given  grade  is  dependent  upon  success  in  the  work  of  the  grade 
next  below  it.  We  believe  that  a  higher  law  supervenes  at  this 
point.  We  believe  that  the  decision  as  to  promotion  should  rest 
upon  a  consideration  of  what  the  child  needs  to  learn  rather 
than  upon  what  he  has  learned.  The  school  exists  for  the  child; 
the  question  of  his  classification  is,  in  the  highest  sense,  to  be 
decided  with  reference  to  the  adjustment  which  the  school  is  thus 
permitted  to  make  to  his  needs. 

We  have  set  up  in  our  American  schools  a  system  of  artificial 
grades.  Having  set  it  up,  we  have  worshiped  not  its  substance  but 
its  form ;  not  the  duty  but  the  temple  built  by  our  own  hands.  We 
have  blinded  ourselves  to  the  fact  that  the  grades  which  we  have 
created  are  only  administrative  devices  intended  to  facilitate  the 
handling  of  large  groups  of  children.  We  have  asserted  the 
sequential  character  of  these  grades  and  maintained  to  the  extent 
of  denying  the  visible  fact  that  children  are  often  entirely  capable 
of  negotiating  the  course  of  study  of  one  grade  without  having 
spent  a  year  negotiating  the  course  of  study  of  the  previous  grade. 
We  have  ignored  unquestioned  evidence  of  the  fact  that  grade 
lines  cannot  be  sharply  drawn;  that  the  overlapping  of  one  grade 
upon  another  is  so  extensive  that  in  individual  cases  membership 
in  a  given  grade  fails  to  establish  to  a  useful  degree  of  accuracy 
what  a  child  knows  or  what  he  can  do. 

One  grade  is  really  distinguished  from  another  by  differences 
in  the  course  of  study.  Sometime  these  differences  are  very  great. 
The  difference,  for  example,  between  the  sixth  and  seventh  grades 
with  respect  to  the  teaching  material  is  especially  pronounced. 
The  New  York  course  of  study  (to  take  a  particular  instance) 
introduces  a  new  history  subject,  two  new  continents  in  geography, 
and  a  course  in  elementary  algebra,  to  say  nothing  of  manual 
training  and  domestic  science.  It  is  our  judgment  that  the 
promotion  of  children  should  take  account  of  the  extent  to  which 
they  have  been  offered  the  course  of  study  of  a  given  grade,  since 
it  is  by  the  course  of  study  rather  than  by  the  attainments  of 
pupils  that  one  grade  is  most  unequivocally  distinguished  from 
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another.  It  is  proper  that  our  promotion  scheme  should  con- 
template the  advancement  of  pupils  from  one  grade  to  another 
on  the  basis  not  of  attainment  but  of  the  course  of  study;  on  the 
basis,  in  other  words,  of  the  course  of  study  to  which  they  have 
been  subjected  and  the  course  which  lies  adjacent  to  it.  There  is 
plenty  of  evidence  to  show  that  causing  a  child  to  repeat  the  work 
of  a  grade  may  cause  no  improvement  in  his  work,  although  it 
is  done  with  the  abiding  faith  that  improvement  will  take  place. 
Under  these  circumstances,  it  is  a  hazardous  undertaking — 
an  undertaking  which  it  is  difficult  to  justify — to  deny  a  pupil 
of,  let  us  say,  the  sixth  grade,  the  opportunity  to  profit  by  the 
richer  curriculum  of  the  seventh  grade. 

I  have  already  stated  that  1,276  pupils  from  the  high  second 
through  the  high  seventh  grades  were  advanced  on  probation 
at  Springfield  and  Decatur  at  the  close  of  the  first  semester  of 
1918-1919.  All  these  pupils  would  have  failed  in  the  ordinary 
course  of  events.  As  a  result  of  the  work  done  during  the  proba- 
tionary period,  however,  something  over  three-quarters  of  them 
maintained  themselves  in  the  grade  to  which  they  had  been 
provisionally  advanced.  By  this  means  the  promotion  rate  for 
these  two  cities  was  raised  to  about  95  percent. 

During  the  second  semester  of  1918-1919 — the  semester  at 
the  beginning  of  which  the  probationary  period  had  occurred— 
the  superintendents  of  Decatur  and  Springfield  obtained  from 
their  teachers  opinions  concerning  this  promotion  scheme.  Super- 
intendent Allen  of  Springfield  secured  an  unsigned  vote  of  the 
teachers  in  which  they  indicated  whether  in  their  judgment  the 
experiment  ought  to  be  continued  another  semester.  The  vote 
was  almost  unanimous  for  continuing  it.  Accordingly,  the 
identical  procedure  which  had  taken  place  in  January  was  repeated 
in  June.  This  time  881  pupils  who  would  ordinarily  have  failed 
were  provisionally  promoted.  This  was  only  about  two-thirds 
as  many  as  had  been  so  promoted  the  semester  before.  The 
drop  was  largely  accounted  for  by  two  circumstances;  first, 
there  was  no  epidemic  during  the  second  semester,  and  second, 
the  second  semester  of  any  school  year  is,  as  all  practical  school 
people  know,  a  better  semester  than  the  first.  In  a  system  having 
semi-annual  promotions  fewer  children  fail  in  June  than  in 
January. 
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The  probationary  period  for  these  881  pupils  did  not,  of 
course,  occur  until  the  following  September  and  October,  that  is 
until  the  fall  of  1919.  Again  three-quarters  of  the  children  made 
good,  and  as  there  were  fewer  probationary  pupils  than  before, 
the  promotion  rate  was  even  higher  than  95  percent. 

Again  it  was  decided  to  continue  the  experiment;  and  in 
January,  1920,  the  list  of  pupils  promoted  on  trial  consisted  of 
984  names.  This  time  the  probationary  period  resulted  in  the 
permanent  promotion  of  only  60  percent  (tf  the  pupils  who  were 
provisionally  advanced.  This  drop  in  the  rate  was  caused  by 
the  fact  that  during  February  and  March  an  epidemic  of  measles, 
followed  by  whooping  cough,  was  so  severe  as  actually  to  close 
up  some  of  the  schools  for  about  two  weeks.  This  disturbance 
occurred  during  the  probationary  period.  Some  receiving  teachers 
rightly  felt  that  in  many  cases  they  had  no  foundation  on  which 
to  base  a  recommendation  for  permanent  promotion. 

One  would  no  doubt  like  to  know  to  what  extent  the  same 
pupils  came  up  for  probation  one  semester  after  another.  If  by 
this  special  process  we  are  able  to  stimulate  pupils  so  that  they 
become  acceptable  as  members  of  a  higher  grade,  it  is  more  than 
likely  that  by  the  time  the  next  lists  are  made  up  they  will  again 
be  found  among  the  doubtful  pupils.  If  such  is  the  case,  our 
promotion  scheme  will  be  continually  addressed  to  much  th^  same 
group  of  incompetent  pupils,  and  the  securing  of  their  promotion 
will  be  a  labor  of  Sisyphus. 

It  will  be  recalled  that  at  the  first  probationary  period  1,276 
pupils  were  on  trial.  Only  172  of  them  came  up  for  the  same 
treatment  at  the  close  of  the  second  semester.  Of  the  same  1,276 
pupils  only  59  were  placed  on  probation  on  all  three  of  the  occa- 
sions when  this  probation  plan  was  used.  Curiously  enough,  by 
no  means  all  of  these  59 — indeed  only  about  half  of  them — were 
found  to  be  mentally  deficient.  Of  the  1,276  who  were  first 
placed  on  probation  only  76  came  up  for  similar  attention  a  year 
later — i.e.,  the  third  semester  of  our  investigation.  Or,  to 
look  at  it  in  another  way,  of  the  original  1,276  probationers  1,087 
did  not  become  probationers  on  either  of  the  two  subsequent 
occasions.  This  represented  more  than  85  percent  of  the  first 
probationary  group.  Similar  statements  could  be  made  concern- 
ing the  second  group. 
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In  many  instances  the  receiving  teacher  and  the  sending 
teacher  were  the  same  person.  In  other  words,  the  teacher 
went  forward  with  the  class.  It  has  sometimes  been  urged  that 
this  kind  of  an  arrangement  will  secure  a  higher  promotion  rate. 
Our  data  did  not  show  this  to  be  the  case.  There  were  in  all 
3,141  cases  of  advancement  on  trial.  In  exactly  1,100  of  these 
cases,  the  teacher  moved  on  with  the  class,  while  in  2,041,  or 
practically  twice  as  many  cases,  the  teacher  changed.  In  cases 
where  the  same  teacher  was  involved  70.3  percent  secured  pro- 
motion. In  cases  involving  a  change  of  teacher  71.9  percent 
secured  promotion.  The  result  when  the  teacher  moved  forward 
with  the  class  was,  therefore,  not  quite  as  good  as  was  the  result 
when  the  teacher  changed,  although  the  difference  was  practically 
negligible. 

One  would  also  like  to  know  the  effect  of  this  promotion 
scheme  on  scholarship.  A  drive  of  this  sort  might  be  expected, 
like  most  concerted  efforts,  to  produce  large  results  in  the  intended 
direction.  The  results,  however,  may  be  accompanied  by  com- 
pensating disadvantages.  Comparing  the  scholarship  of  pupils 
during  the  probationary  period  with  their  scholarship  at  the 
beginning  of  the  probation,  we  found  that  74  percent  of  the  pupils 
who  consummated  their  promotion  to  the  higher  grade  gained  in 
scholarship;  that  24  percent  of  them  neither  gained  nor  lost; 
and  that  only  the  remaining  2  percent  lost  ground.  It  would  be 
natural  to  suppose,  on  the  other  hand,  pupils  who  failed  to  secure 
promotion  despite  the  efforts  during  the  probationary  period 
would  show  a  loss  in  scholarship.  A  stationary  condition,  how- 
ever, was  the  prevailing  one  for  these  pupils.  The  records  stood 
at  9  percent  gained,  7  percent  lost,  and  84  percent  unchanged. 
Of  the  entire  3,141  probationary  cases,  56  percent  showed  im- 
provement in  scholarship;  41  percent  showed  no  change,  and 
3  percent  showed  a  loss.  It  is  a  curious  fact  that  most  of  the  loss 
in  scholarship  occurred  on  the  occasion  of  the  first  use  of  the  total 
promotion  plan,  namely  in  February,  1919.  The  results  expressed 
in  terms  of  improvement  in  scholarship  were  appreciably  better 
on  the  second  and  third  trials  of  the  experiment. 

It  may  seem  that  a  comparison  of  the  scholarship  as  evinced 
during  the  probationary  period  with  the  scholarship  shown  at 
the  beginning  of  it  is  unconvincing.    More  convincing  would  be 
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a  statement  of  the  broad  general  effect  of  the  95  percent  promo- 
tion rate  on  the  scholarship  of  all  the  pupils  in  all  the  grades. 
One  might  indeed  expect  and  condone  a  small  falling-off  in  the 
ratings  of  pupils.  Grade  standards  are  not  the  highest  objectives 
in  any  school.  They  may  be  purchased  far  too  dearly.  The 
comparison  of  median  grade  scores  with  the  norms  of  standard 
tests  may  lead  to  unfair  conclusions.  Not  a  few  schools  maintain 
high  grade  standards  not  because  the  pupils  are  either  capable  or 
well  taught  but  because  all  but  the  most  capable  are  held  back 
and  eliminated. 

Be  this  as  it  may,  the  comparison  of  the  scholarship  records 
at  Springfield  and  Decatur  before  the  experiment  and  afterwards 
will  be  suggestive.  Combining  the  percentage  ratings  of  all  the 
pupils  in  the  elementary  schools  of  these  two  cities,  we  find  that 
the  average  for  the  semester  ending  in  January,  1919,  was  80.4. 
This  was  the  result  prior  to  the  installation  of  the  new  plan  of 
promotion.  The  corresponding  figure  for  the  semester  ending 
June,  1919,  was  81.4.  This  was  after  75  percent  of  all  the  children 
who  under  ordinary  circumstances  would  have  been  held  back 
had  been  advanced  to  a  higher  grade.  The  figure  denoting  the 
average  scholarship  of  all  the  pupils  in  both  cities  and  for  all 
subjects  had  not  fallen.  In  fact,  so  far  as  there  was  a  change,  it 
had  been  in  the  direction  of  improvement — namely  from  80 . 4  to 
81.1. 

A  fuller  effect  of  the  new  promotion  plan,  however,  might 
be  expected  to  be  registered  after  two  semesters — that  is,  after 
the  schools  had  twice  put  the  plan  into  effect.  The  average 
scholarship  rating  at  the  end  of  the  second  semester  of  the  experi- 
ment was  82 . 2.  Again  the  scholarship,  as  far  as  it  was  measured 
by  the  official  school  ratings,  had  not  fallen.  As  a  matter  of  fact, 
it  had  again  risen  slightly.  To  recapitulate:  the  three  figures 
indicating  the  scholarship  before  the  experiment,  the  scholarship 
after  one  semester  of  it  and  the  scholarship  after  two  semesters 
of  it  were  80.4,  81.1,  and  82.2. 

Our  investigation  covered  a  number  of  additional  topics 
on  which  it  would  take  too  long  to  enlarge.  Perhaps  I  ought, 
however,  to  allude  to  the  analysis  which  we  made  of  the  causes  of 
failure,  or  rather  in  this  case,  the  causes  of  the  recommendation 
for  trial  promotion.    Since  this  recommendation  for  trial  promo- 
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tion  was  primarily  the  same  as  the  usual  recommendations  for 
failure,  the  causes,  so  far  as  they  operated  in  this  case,  would 
have  general  significance.  We  recognized  seven  causes  of  failure, 
and  I  list  them  in  the  order  of  their  frequency  of  mention  by  the 
teachers  as  operating  causes,  first  being  the  most  frequently 
mentioned:  (1)  wrong  attitude  toward  the  school;  (2)  mental 
defect;  (3)  irregular  attendance;  (4)  poor  home  conditions;  (5) 
physical  defect;  (6)  changing  from  one^school  to  another;  (7)  poor 
social  conditions.  When  we  try  this  experiment  again,  we  shall 
more  definitely  relate  the  device  to  be  used  in  the  probationary 
period  to  these  alleged  causes  of  failure. 

We  realize  that  these  causes  are  not  mutually  exclusive. 
There  are  those  who  assert  that  the  fundamental  cause  is  mental 
defect,  and  that  wrong  attitude,  poor  home  conditions,  changing 
from  one  school  to  another,  irregular  attendance,  and  poor  social 
condition  are  attributable  to  a  low  level  of  intelligence  either 
on  the  part  of  the  pupil  or  on  the  part  of  the  family.  So  far  as  the 
mental  deficiency  of  the  pupil  is  concerned,  we  have  some,  though 
by  no  means  complete,  evidence  that  the  failure  of  pupils  was 
neither  exclusively  nor  to  a  very  large  extent  due  to  it.  I  have 
already  referred  to  the  59  pupils  who  were  put  on  probation  three 
times.  It  would  seem  that  mental  defect  would  be  especially 
prevalent  in  this  group.  The  results  of  our  investigations,  however, 
did  not  support  this  presumption.  Not  more  than  one-half  of 
them  could  be  pronounced  defective. 

Our  experiment  proved  interesting  even  beyond  our  expecta- 
tions. The  value  of  such  a  method  of  promoting  pupils  cannot 
perhaps  be  determined  from  an  application  of  it  in  two  cities  whose 
total  elementary  school  enrollment  does  hot  exceed  thirteen  or 
fourteen  thousand;  but  when  the  method  is  tried  not  once,  but 
three  times  and  when  the  results  are  so  uniformly  favorable,  we 
feel  that  we  are  sufficiently  modest  if  we  maintain  that  it  offers 
interesting  and  important  possibilities  in  administration. 


A  CONSTRUCTIVE  PROGRAM  IN  SILENT  READING* 

Ernest  Horn 
Staie  University  of  Iowa 

The  first  step  in  a  constructive  program  in  silent  reading  is  to 
mark  out  the  objectives  to  be  attacked.  The  material  which  we 
read  silently  falls  into  two  large  classes :  that  of  a  literary  nature, 
read  primarily  for  leisure  purposes,  and  that  of  an  informational 
character,  read  for  the  most  part  with  a  work  attitude.  While  the 
abilities  involved  in  the  appreciation  of  literature  are  very  signif- 
icant, it  seems  wiser  to  classify  them  under  the  term  literature  and 
to  develop  them  by  special  technics.  At  any  rate,  in  this  dis- 
cussion the  term  silent  reading  will  be  used  as  a  group  name  for 
those  abilities  which  insure  efficient  work  with  books.  The  aims 
involved  in  this  type  of  reading  are  more  easily  determined  and 
more  easily  understood  than  in  the  case  of  literature,  where  the 
objectives  are  troublesome  to  mark  out,  the  method  of  treatment 
hard  to  discover,  and  the  results  difficult  to  test.  Certainly  the 
standards  for  judging  the  two  abilities  are  not  the  same.  For 
example,  it  is  by  no  means  clear  that  it  is  always  desirable  to  read 
literature  rapidly.  The  individual  who  reads  two  stories  in  an 
hour  does  not  benefit  twice  as  much  as  he  who  reads  but  one  in  the 
same  time.  As  a  matter  of  fact,  as  in  the  case  of  poetry,  it  is  often 
not  even  desirable  to  read  literature  silently  at  all. 

Most  of  the  tests  and  discussions  of  silent  reading  have  empha- 
sized two  abilities,  speed  and  comprehension.  To  these  must  be 
added  two  others,  namely,  the  ability  to  organize  and  the  ability 
to  remember.  Organization  may  be  regarded  as  a  logical  part  of 
comprehension,  but  in  any  program  for  the  improvement  of  this 
ability  it  is  necessary  to  focus  upon  it  as  a  special  objective.  The 
ability  to  remember  what  has  been  read  involves  special  technics 
which  are  not  likely  to  be  developed  unless  specifically  set  out  and 
practiced.  It  is  possible  that  a  fifth  group  of  abilities  should  be 
added  to  these  four,  including  such  technics  as  judging  the  worth 
of  books;  and  the  proper  use  of  indexes,  tables  of  contents,  of 

'  A  paper  presented  at  the  meeting  of  the  National  Association  of  Directors  of 
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dictionaries,  encyclopedias,  other  reference  works,  the  card  index, 
and  other  library  aids. 

Of  these  abilities  perhaps  comprehension  should  be  most 
strongly  emphasized.  In  fact  comprehension  is  necessary  as  a 
basis  for  progress  in  any  of  the  other  abilities.  Rapid  reading  with- 
out comprehension  is  of  no  value.  It  is  impossible  to  organize 
properly  unless  one  understands  the  detail  of  the  material  which 
is  to  be  organized.  Accuracy  of  comprehension  is  necessary  if 
material  which  is  memorized  is  to  be  of  any  use. 

Constructive  Program  in  Comprehension  ,  ' 

The  simplest  element  to  which  the  problem  of  comprehension 
can  be  reduced  is,  of  course,  the  word.  In  the  last  thirty  years 
there  have  been  a  great  number  of  very  helpful  studies  of  the  vo- 
cabularies of  children.  All  this  information  should  be  gathered  up. 
There  is  need,  also,  of  further  investigations  which  will  give  us  a 
more  adequate  idea  of  the  type  and  extent  of  children's  vocabu- 
laries in  the  various  grades.  There  is  particular  need  for  some 
definite  knowledge  of  the  accuracy  of  comprehension  of  the  three 
or  four  thousand  words  which  may  be  regarded  as  basic  in  any 
reading  vocabulary.  It  seems  quite  possible  that  one  of  the  chief 
contributions  of  the  kindergarten  and, early  primary  grades  will 
be  to  give  the  children  an  enriched  and  highly  accurate  vocabu- 
lary. 

Our  reading  and  language  tests  have  added  to  our  informatioh 
as  to  the  ability  of  pupils  to  read  sentences  of  varying  length  and 
complexity.  We  need,  however,  much  more  careful  studies  to 
point  out  degrees  of  difficulty  in  various  types  of  sentences  and  to 
discover  the  elements  of  sentence  structure  which  cause  most 
difficulty.  As  a  part  of  this  work  it  is  important  to  have  a  study 
of  technics  by  which  pupils  may  be  encouraged  to  read  in  terms  of 
thought  units. 

The  low  ability  of  students  to  understand  paragraphs  has  been 
shown  by  such  studies  as  that  of  Thorndike.  During  the  last  three 
years  there  have  been  a  number  of  experiments  at  the  University 
of  Iowa  to  determine  the  ability  of  students  to  read  paragraphs 
taken  from  textbooks  in  such  subjects  as  history,  geography, 
mathematics,  hygiene,  and  science.  The  following  is  typical  of 
the  selections  and  exercises  used. 
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I  want  to  s^e  how  carefully  you  can  read  a  short  paragraph.  After 
ypu  have  read  it  you  will  be  asked  to  answer  some  questions  about  it.  In 
answering  these  questions  there  are  three  things  you  should  remember.  They 
are: 

1.  Give  just  the  information  needed  to  answer  each  question  but  make 
sure  that  the  answer  you  give  is  to  be  found  in  the  paragraph. 

-   2.  If  any  question  is  asked  for  which  you  think  there  is  no  answer  given 
in  the  paragraph,  write  on  your  paper,  "The  paragraph  does  not  tell." 

3.  You  may  read  the  paragraph  as  often  as  you  wish  to  make  sure 
your  answers  are  correct. 

Now  that  you  know  exactly  what  to  do,  read  the  following  paragraph 
and  answer  the  following  questions  just  as  you  have  been  told,  remembering 
that  you  may  have  all  the  time  that  you  need. 

Pioneer  Furniture 
The  big  fireplace  would  be  among  the  first  things  to  attract  attention. 
Above  it,  resting  on  a  shelf,  or  mantel,  would  be  seen  a  candle,  a  clock 
and  one  of  the  housewife's  most  beautiful  plates.  Within  the  fireplace 
fastened  at  one  side  would  be  seen  the  crane  upon  which  hang  the  kettles 
over  the  blazing  fire. 

Sketch  the  picture  you  see  when  reading  this  paragraph. 

A  large  proportion  not  only  of  the  elementary-school  children 
but  also  of  high-school  and  college  students  and  even  of  super- 
intendents drew  for  a  pioneer  clock  a  modern  alarm  clock. 

After  using  this  illustration  in  a  lecture  on  the  subject  of  silent 
reading  a  teacher  in  the  audience  decided  to  test  the  comprehen- 
sion of  some  of  her  pupils.  The  class  was  reading  in  preparation 
for  Washington's  birthday.  One  pupil  had  just  read  the  sentence 
"Washington  was  very  fond  of  outdoor  sports."  Upon  being  asked 
the  meaning  of  this  sentence  he  said,  "Those  were  the  fellows  he 
ran  around  with." 

.  It  is  entirely  possible  that  much  of  the  difficulty  college  stu- 
dents have  in  their  work  grows  out  of  their  inability  to  read  accu- 
rately. In  a  series  of  experiments  now  being  conducted  at  the 
University  of  Iowa,  it  is  shown  quite  clearly  that  there  is  a  con- 
siderable number  of  students  who  cannot  read  anywhere  nearly 
as  well  as  some  students  in  the  elementary  school.  In  fact  stu- 
dents are  found  in  the  freshman  class  who  score  in  comprehension 
only  one-fifth  as  high  as  some  of  the  elementary-school  children. 
A  great  many  university  students  were  found  whose  reading 
ability  was  of  such  a  nature  as  to  constitute  a  very  serious  handicap. 
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The  main  principles  underlying  a  constructive  program  in  im- 
provement of  this  ability  are: 

1.  The  course  of  study  must  be  enriched.  This  is  not  only  the 
best  method  by  which  a  vocabulary  may  be  made  more  accurate 
and  more  extended,  but  it  is  also  the  best  means  of  insuring  that 
a  large  amount  of  factual  material  will  be  read. 

2.  It  must  be  recognized  that  comprehension  can  best  be 
taught  and  measured  where  material  is  logical  and  factual  in 
character.  For  the  purposes  of  developing  comprehension,  literary 
materials  are  likely  to  be  inferior  to  selections  which  deal  with 
such  subjects  as  history,  science,  and  geography. 

3.  Some  of  the  best  teaching  of  comprehension  can  be  done  in 
coimection  with  the  proper  assignment  of  lessons.  If  assignments 
are  focalized,  if  they  involve  large  amounts  of  reference  reading,  and 
if  the  study  period  is  properly  supervised  the  study  involved  con- 
stitutes a  very  efficient  and  practical  method  of  improving  the 
ability  of  pupils  in  the  comprehension  of  what  they  read. 

4.  As  a  part  of  all  exercises  in  comprehension  great  care  must 
be  taken  to  provide  rigorous  tests.  Not  only  should  the  student 
have  an  opportunity  to  show  how  accurately  he  has  comprehended 
what  he  has  read,  but  he  should  develop  definite  prejudices  against 
reading  which  results  in  "half  baked"  or  inaccurate  ideas. 

Constructive  Program  in  Speed 

We  shall  probably  find  that  too  much  attention  has  been  given 
in  the  last  three  or  four  years  to  the  development  of  speed  in  silent 
reading.  No  doubt  this  is  due  to  the  fact  that  speed  in  reading  is 
easier  to  measure  than  are  any  of  the  other  qualities.  Small  im- 
provements and  differences  are  comparatively  easily  shown. 
Moreover,  considerable  improvement  may  be  made  rather  easily, 
since  the  prevailing  rate  of  reading  is  in  general  rather  low. 

In  brief,  studies  of  the  status  of  speed  in  reading  seem  to  show 
that  the  improvement  in  this  ability  in  grades  iv-viii  and  beyond 
is  not  what  it  should  be.  For  a  time  the  flattening  out  of  this 
improvement  curve  led  many  students  of  the  problem  to  assume 
that  the  ability  was  approaching  its  limit,  and  that  additional 
practice  exercises  would  give  a  small  amount  of  return.  However, 
the  ease  with  which  the  standard  rates   for  the  various  grades 
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have  recently  been  surpassed  by  experimental  groups  seems  to 
indicate  that  the  rate  for  the  intermediate  and  grammar  grades 
is  probably  the  result  of  poor  methods  of  teaching. 

It  should  be  clear  that  one  ought  not  to  speak  of  speed  in  silent 
reading  but  rather  of  speeds  in  silent  reading.  The  rate  at  which 
one  should  read  is  determined  both  by  the  material  read  and  by 
the  purpose  in  mind.  It  is  quite  possible  for  sixth-grade  children 
to  skim  at  rates  running  from  six  to  nine  hundred  words  a  minute 
and  to  do  so  with  perfect  efficiency  where  the  purpose  is  to  discover 
the  answer  to  a  simple  question.  On  the  other  hand,  where  mate- 
rial is  rather  difficult  and  is  to  be  learned  with  some  completeness, 
a  reading  rate  of  one  hundred  words  a  minute  for  the  same  children 
might  be  high. 

How  speed  may  be  improved. — In  all  grades,  and  especially  in 
the  earlier  years,  provision  must  be  made  for  eliminating  mechani- 
cal distractions  and  for  giving  control  of  the  mechanical  phases  of 
reading.  All  special  exercises,  such  as  phrase  flashing,  speed  ex- 
ercises in  reading  short  directions,  etc.  should  have  for  their  pur- 
pose the  shortening  and  strengthening  of  the  bonds  between  the 
printed  symbol  and  the  idea  for  which  the  symbol  stands.  It 
should  be  remembered  that  it  is  quite  probable  that  all  tendencies 
to  articulation  are  harmful  except  in  the  case  of  verbatim  memor- 
izing. 

This  raises  the  whole  question  of  the  teaching  of  phonics.  It 
seems  probable  that  any  tendency  to  stop  to  analyze  a  word 
phonetically  constitutes  a  distraction,  although  at  some  times  a 
necessary  one.  A  reference  to  phonics  should  be  made  by  the  child 
under  much  the  same  circumstances  as  those  under  which  we  re- 
fer to  the  dictionary.  In  other  words,  he  should  not  be  conscious 
of  the  phonic  make-up  of  a  word  except  when  he  must  use  this 
knowledge  to  determine  what  the  word  is.  Perhaps  an  investiga- 
tion is  needed  to  show  whether  or  not  there  is  some  subtle  phonetic 
sense  which  aids  in  the  rapid  identification  of  symbols  even  when 
the  reader  is  not  conscious  of  the  use  of  phonics. 

It  is  the  writer's  judgment  that  a  small  amount  of  phonics 
should  be  taught  in  grades  i,  ii,  and  iii;  and  that,  beginning  in 
grade  iv,  a  transition  should  be  made  to  the  pronunciation  keys 
in  the  dictionary. 

Basic  principles. — The  most  essential  condition  for  exercise 
in  the  improvement  of  speed  is  perhaps  to  be  described  under  the 
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term  "time  pressure."  If,  however,  the  exercises  are  to  be  given 
so  that  proper  reading  habits  will  be  developed,  the  child  must 
read  within  the  limits  of  perfect  comprehension,  and  should  realize 
that  the  results  of  his  reading  will  be  rigorously  tested.  These 
conditions  hold  whether  or  not  the  exercise  consists  of  short  word 
and  phrase  flashing  or  of  the  reading  of  longer  selections. 

In  the  case  of  longer  selections,  such  as  are  found  in  the 
ordinary  text,  other  conditions  should  exist.  First,  the  material 
should  be  factual  in  character.  Second,  the  child  should  have  a 
purpose  to  guide  him  in  his  reading.  Third,  he  should  read  at 
top  speed  but  within  the  limits  of  perfect  comprehension  and 
without  fluster.  Fourth,  he  should  be  tested  rigorously  over  the 
material  read. 

Where  this  is  done  there  will  be  not  only  an  increase  in  speed 
but  also  a  large  increase  in  comprehension.  Dr.  O'Brien's  experi- 
ment, reported  in  the  Twentieth  Yearbook  oj  the  National  Society 
for  the  Study  of  Education,  Part  II,  showed  that,  according  to 
one  method  of  computation,  the  groups  having  special  silent- 
reading  drill  made  31  percent  more  improvement  than  the  groups 
having  the  ordinary  work  in  reading. ^  Of  course,  such  improve- 
ment is  eminently  worth  trying  for.  But  from  preliminary 
experiments,  organized  on  a  somewhat  different  basis,  it  seems 
clear  that  as  great  an  increase  may  be  obtained  in  comprehension 
as  in  speed.  For  example,  in  one  exercise  children  are  given  a 
problem,  the  answer  to  which  they  are  to  get  by  reading.  They 
are  asked  to  read  at  top  speed  but  within  the  limits  of  perfect 
comprehension.  They  read  with  the  knowledge  that  they  are 
to  be  tested.  At  the  close  of  the  exercise  a  rigorous  test  is  given 
in  order  to  determine  whether  or  not  the  answer  which  they 
secured  was  the  complete  and  accurate  answer  to  the  question 
for  which  they  read.  There  is  reason  to  believe  that  the  effect 
of  reading  under  the  guidance  of  a  problem  is  not  only  to  speed 
the  child  up  but  also  to  make  conditions  favorable  for  more 
adequate  comprehension.  At  any  rate,  comprehension  scores  and 
speed  scores  do  improve  very  rapidly  where  such  drill  exercises 
are  given. 

In  addition  to  such  special  exercises  as  have  just  been  described, 
there  should  be  a  large  amount  of  reading  of  rather  easy  materials. 

*  O'Brien,  John  A.  "The  development  of  speed  in  silent  reading,"  Twentieth 
Yearbook  of  the  National  Society  for  the  Study  of  Education,  Part  II,  p.  61,  1920. 
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This  may  be  done  in  a  free  reading  period  and  in  directed  home 
reading.  For  this  purpose  literary  material  may  be  used  along 
with  books  of  an  informational  sort.  Without  entering  into  a 
discussion  of  the  reasons  for  this  type  of  reading,  it  is  significant 
that  most  students  of  the  problem  of  improving  speed  in  silent 
reading  encourage  extensive  reading  of  easy  material. 

I  do  not  believe  we  are  yet  in  *  position  to  say  what  sort  of 
speed  scores  may  be  expected  in  the  case  of  children  in  the  various 
grades.  As  pointed  out  earlier  in  this  paper,  the  scores  will  vary 
with  the  type  of  material  and  with  the  purpose  for  which  it  is  read. 
In  the  case  of  such  careful  reading  as  students  should  do  in 
preparing  their  geography  and  history  lessons,  the  rate  is  probably 
less  than  children  make  on  the  Courtis  test.  According  to 
Dr.  Germane's'  findings,  the  rates  in  words  per  minute  at  which 
the  children  of  a  certain  city  read  an  article  on  tuberculosis  were: 
sixth  grade,  168.1;  seventh  grade,  168.9;  eighth  grade,  185.0. 
In  the  same  city,  the  rates  for  reading  an  article  on  peanuts  were: 
sixth  grade,  165.9;  seventh  grade,  171.5;  eighth  grade,  197.5. 
Judging  from  the  comprehension  scores,  even  this  rate  was  too 
hurried. 

However,  children  who  had  had  special  drill  were  found  to 
read  these  exercises  with  much  greater  speed,  and  with  much 
better  comprehension. 

The  Constructive  Program  in  Organization 

In  a  way  organization  may  be  regarded  as  subordinate  to 
comprehension,  but  no  amount  of  practice  in  the  comprehension 
of  the  detailed  data  of  an  article  will  give  satisfactory  power  in 
organization.  This  ability  is  very  important.  A  very  great 
proportion  of  the  reading  which  we  do  involves  the  necessity  of 
getting  at  the  main  points  and  of  organizing  these,  usually  accord- 
ing to  some  purpose.  Dr.  Germane  found  that  a  summary  of 
material  read  often  gave  smaller  returns  than  the  same  amount 
of  time  spent  in  thoughtful  re-reading.  A  study  of  the  detail  of 
his  experiment  revealed  that  this  was  due  to  the  fact  that  an 
ordinary  pupil  could  not  organize  the  material  in  the  selection 
adequately  and,  therefore,  could  not  summarize.  This  points 
rather  clearly  to  the  need  of  frequent  and  rigorous  exercises  in 

'  Germane,  Charles  E.  The  value  of  summarizing  in  silent  reading  as  compared 
with  the  re-reading  of  the  same  article.    Doctor's  thesis,  State  University  of  Iowa. 
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getting  the  main  points  out  of  a  paragraph  or  chapter.  Detailed 
exercises  cannot  be  given  here.  It  seems  probable,  however,  that 
the  best  conditions  under  which  such  exercises  may  be  developed 
are  to  be  found  in  the  regular  work  of  the  school.  If  assignments 
are  focalized  and  detailed,  if  the  student  is  encouraged  to  work 
carefully  but  at  top  speed  during  his  study  period,  and  if  the 
recitation  is  based  on  the  questions  put  in  the  assignment,  con- 
siderable ability  to  organize  will  be  developed.  However,  short 
exercises  are  necessary  in  order  to  put  before  students  standards 
of  the  sort  of  work  they  are  expected  to  do,  and  in  order  to  develop 
proper  methods  of  work. 

Constructive  Program  in  Remembering 

The  constructive  program  in  the  development  of  the  ability 
to  remember  what  is  read  is  based  upon  two  things:  first,  that  a 
single  reading  ordinarily  gives  a  very  small  return,  and  that  even 
this  small  return  is  very  rapidly  forgotten  unless  additional  work 
is  done  to  fix  the  material;  and  second,  that  there  are  certain 
technics  which  are  superior  for  learning  material  thoroughly  and 
for  future  use. 

An  investigation  by  Yoakum*  showed  that  the  amount  of 
material  that  could  be  reproduced  immediately  as  the  result  of  a 
single  reading  varied  with  types  of  material,  but  that  ordinarily 
the  proportion  retained  ranged  from  20  to  40  percent.  He  found 
also  that  unless  the  material  were  read  a  second  time,  or  unless 
some  exercise  was  given  to  fix  this  material,  very  little  would  be 
retained  after  a  few  days. 

As  to  the  technic  of  remembering  materials,  Germane's 
investigation  seems  to  show  that  until  students  have  learned 
to  summarize  efficiently,  better  results  are  to  be  obtained  by 
continued  thoughtful  re-reading,  and  by  summarizing  with  the 
aid  of  questions  prepared  by  the  teacher.  As  in  the  case  of  other 
exercises,  the  best  work  in  establishing  the  habit  of  learning 
material  for  future  use  can  probably  be  done  in  connection  with 
such  subjects  as  geography,  hygiene,  nature  study,  and  history. 
The  proper  conditions  seem  to  be  to  read  under  the  guidance  of 
a  problem  or  series  of  problems;  to  read  directly  through  the 
article  at  fair  speed  but  within  the  limits  of  perfect  comprehension; 

♦  Reported  in  part  in  the  Twentieth  Yearbook  of  the  National  Society  for  the  Stitdy 
of  Education,  Part  II,  jagt  lbs. 
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to  have  a  set  of  questions,  preferably  the  set  presented  in  the 
assignment,  which  may  be  used  for  self-testing  and  as  a  basis 
for  summarizing  the  material. 

Dangers 

As  a  sort  of  summary  to  what  has  been  said,  it  may  be  well 
to  point  out  certain  dangers  which  must  be  guarded  against 
particularly. 

First,  speed  exercises  are  likely  to  develop  a  habit  of  "half- 
baked"  and  careless  reading,  unless  there  be  a  strong  emphasis 
upon  comprehension  and  upon  rigorous  tests  of  results  attained. 
Teachers  must  be  urged  to  keep  in  mind  always  that  only  within 
the  limits  of  accurate  comprehension  are  speed  exercises  safe. 

Second,  there  is  a  danger  that  an  interest  in  devices  and  in 
more  or  less  spectacular  methods  will  weaken  the  teacher's  attack 
on  some  of  the  more  prosaic  but  necessary  exercises.  Certain 
devices,  such  as  those  which  involve  following  directions  and 
rapid  flash  card  work  are  novel.  Moreover,  they  make  good 
show  lessons.  A  teacher  must  keep  in  mind  that  her  best  work  will 
be  done  with  exercises  which  approximate  the  sort  of  reading  pupils 
are  most  frequently  called  upon  to  do  in  preparing  lessons. 

i  Third,  there  is  danger  that  teachers  will  use  methods  which, 
while  attractive,  are  very  uneconomical  as  methods  of  learning 
to  read.  This  is  particularly  true  of  such  exercises  as  those  in 
which  the  pupil  constructs  something  in  answer  to  a  reading 
lesson.  The  chief  value  in  the  construction  is  its  measure  as  a 
test  of  complete  comprehension.  This  is,  of  course,  a  real  contri- 
bution for  any  exercise  to  make.  Where  such  a  test  necessitates 
construction  work  extending  over  a  period  of  20  or  30  minutes  it 
i^  clear  that,  for  the  purpose  of  developing  ability  in  reading,  the 
test  is  very  expensive  in  time. 

J  Fourth,  there  is  a  danger  that  an  undesirable  consciousness  of 
the  process  of  reading  will  be  developed.  In  such  a  case  the  child 
goes  through  the  motions  of  reading  very  rapidly,  but  the  con- 
sciousness of  the  process  operates  as  a  distraction.  It  is  best  to 
avoid  asking  the  pupil  to  read  carefully,  or  to  read  accurately, 
or  to  read  fast,  but  rather  to  give  such  directions  as,  "Will  you 
find  as  quickly  as  you  can  the  answer  to  this  question,  'What  axe 
the  uses  to  which  peanuts  are  put'?"  Such  a  question  puts  the 
child's  attention  where  it  belongs,  namely,  upon  the  thought,  and 
will  tend  to  insure  the  avoidance  of  any  undesirable  reading 
consciousness. 


PRESENTING  EDUCATIONAL  MEASUREMENTS  SO  AS 
TO  INFLUENCE  THE  PUBLIC  FAVORABLY* 

Carter  Alexander 
State  Department  of  Public  Instruction,  Madison,  Wisconsin 

1.  The  Situation 

The  growth  of  educational  measurements  during  the  past 
decade,  curiously  enough,  cannot  be  adequately  described  in 
simple  numerical  terms.  We  have  statistics  enough  about  the 
number  of  tests  sold,  the  numbers  of  books  and  articles  treating 
of  measurements,  and  the  lists  of  courses  in  measurement  work 
offered  in  schools  of  education  and  summer  sessions.  But  this 
growth  has  been  so  phenomenal  that  mere  figures  are  too  weak 
to  express  it.  To  do  it  justice,  we  need  to  employ  forceful  images 
such  as  likening  it  to  the  gigantic  business  expansions  of  the 
war  period. 

But  the  great  business  concerns  have  been  forced  to  curtail 
expansion  and  to  devote  their  major  energies  to  securing  public 
demand  for  relatively  small  outputs.  In  like  manner  numerous 
signs  indicate  to  a  thoughtful  observer  that  educational  measure- 
ments must  soon  face  a  similar  situation.  Effective  work  in 
school  measurements  requires  amounts  of  money  which  unin- 
formed taxpayers  will  surely  withhold.  As  a  new  movement 
in  school  work  and  as  an  agency  certain  to  secure  and  to  publish 
the  exact  facts,  it  will  be  early  attacked  by  unscrupulous  politi- 
cians accustomed  to  raise  the  economy  cry  with  reference  to  public 
expenditures.  To  secure  adequate  financial  support,  it  will  be 
as  necessary  in  the  near  future  for  a  measurement  bureau  to 
convince  the  taxpayers  that  it  gives  unusual  value  for  their 
money,  as  it  now  is  for  an  automobile  manufacturer  or  a  clothing 
merchant  to  prove  that  he  is  offering  a  superior  product  at  a 
bargain. 

For  the  sake  of  better  schools  it  is  highly  desirable  that 
the  educational  rneasurement  movement  go  steadily  forward 
unhampered  by  lack  of  necessary  financial  support.  To  this  end 
the  speaker  offers  suggestions  derived  from  an  extensive  study 
of  the  claims  made  for  measurement  work,  as  well  as  of  publicity 
efforts  in  various  school  lines  and  in  business  salesmanship.  Most 
analyses  of  successful  procedure  in  publicity  and  salesmanship 

*  Address  delivered  in  part  before  the  meeting  of  National  Association  of  Directors 
of  JEducational  Research,  Atlantic  City,  N.  J.,  March  3,  1921. 
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stress  the  use  of  talking  points  and  the  handling  of  objections. 
Accordingly,  it  seems  profitable  to  use  this  classification  here. 

II.  Talking  Points  on  Measurement  for  Strong  Appeals 
TO  THE  Public 

1.  Factual  basis. — The  average  taxpayer,  in  a  time  like  the 
present  financial  stringency,  is  disposed  to  fight  all  appropriation 
increases.  His  representatives  know  this  and  make  a  display  of 
voting  against  heavier  taxes.  To  overcome  such  opposition,  a 
cause  must  rely  upon  one  or  more  of  three  supports.  It  must  show 
a  powerful  emotional  appeal,  it  must  demonstrate  that  it  is 
backed  by  an  array  of  votes  not  safely  to  be  ignored  by  a  politi- 
cian, or  it  must  present  its  needs  with  such  sound  and  exhaustive 
exhibits  of  facts  that  no  reasonable  voter  can  refuse  its  requests. 
School  measurement  work  at  present  cannot  hope  to  arouse 
much  emotional  support,  although  there  should  in  time  be  a 
chance  to  exploit  the  very  excellent  work  now  being  done  in 
giving  neglected  children  individual  attention  through  disclosures 
made  as  a  result  of  measurement  work.  Some  of  the  items  on 
work  for  neglected  individuals  reported  at  this  convention  have 
all  the  emotional  possibilities  that  even  a  welfare  worker  of  the 
"sob"  school  could  desire.  At  present  measurement  work  4ias 
little  chance  to  secure  support  through  popular  votes.  But  it 
deals  with  facts  as  does  no  other  phase  of  school  work.  It  has  an 
enviable  opportunity  to  show  a  hard-headed  business  man  or 
taxpayer  that  its  requests  for  money  are  founded  upon  a  minimum 
of  theory  and  a  maximum  of  facts.  It  can  evolve  a  presentation 
based  upon  facts  that  cannot  be  really  opposed  and  that  can  be 
answered  only  by  evasion.  It  is  thoroughly  equipped  to  show 
up  such  evasion  for  precisely  what  this  procedure  is  worth. 

2.  Definiteness  and  finality. — The  average  citizen  interested 
in  education  does  not  care  for  vague  general  criticisms  of  school 
work.  He  distrusts  elaborately  qualified  evaluations.  He  has 
no  patience  with  the  type  of  scientific  "hedging"  so  often  heard 
at  our  measurement  discussions,  "these  conclusions  are  only 
tentative,"  or  "this  is  probably  the  safer  hypothesis  unless  so-and- 
so  should  prove  to  be  true,  which  cannot  be  fully  established 
until  further  investigations  are  made."  Such  cautious  statements, 
while  indispensable  at  scientific  meetings,  only  incite  his  ridicule. 
He  desires  a  direct  authoritative  statement  of  what  is  really 
known.    If  a  thing  is  uncertain,  it  had  in  his  opinion  better  not 


May,  1921  EDUCATIONAL  MEASUREMENTS  347 

be  mentioned.  He  desires  this  statement  to  be  clean-cut  and  often 
prefers  it  expressed  in  approximate  numerical  terms.  Measure- 
ment work  can  point  out  the  particular  grade  in  a  school  system 
that  needs  special  attention.  It  can  state  that  the  work  in  this 
grade  is  weakest  in  a  certain  subject.  It  can  specify,  for  instance, 
that  the  arithmetic  shows  better  results  in  speed  than  in  accuracy. 
It  can  analyze  the  fundamental  processes  involved  and  show 
just  which  ones  need  strengthening.  It  can  show  how  any  such 
record  compares  with  a  standard  or  with  work  in  comparable 
schools.  All  such  things  can  be  done  with  greater  definiteness 
and  finality  by  measurement  work  than  by  any  other  form  of 
supervision. 

3.  Brevity. — In  regard  to  school  needs,  the  average  citizen 
is  like  the  Yale  students  who  were  never  converted  by  any 
sermon  after  the  first  twenty  minutes  of  it.  He  is  not  apt  to  be 
converted  to  increased  school  taxes  after  the  first  twenty  minutes 
of  any  given  effort.  Measurement  work,  by  virtue  of  its  power 
to  express  its  summaries  and  comparisons  in  statistical  terms, 
has  a  distinct  advantage  in  the  public  presentation  of  its  needs 
over  many  other  phases  of  school  work.  A  measurement 
bureau,  for  instance,  ought  to  be  able  to  prove  the  case  on  any 
reasonable  school  need  for  more  money  in  a  fraction  of  the 
number  of  pages  or  lines  of  type  necessary  for  many  other  school 
workers  who  might  try  to  prove  the  same  case. 

4.  Impersonality. — Theoretically,  measurement  work  makes 
its  studies  with  less  personal  bias  or  pre-judgments  than  any 
other  kind  of  educational  investigation.  In  actual  practice 
measurement  work  sometimes  appears  to  attempt  to  measure 
phases  of  school  activity  that  are  not  easily  or  profitably  sub- 
jected to  numerical  treatment,  and  to  stress  formal  matters  un- 
duly. But  if  measurement  workers  are  reasonably  careful  and 
use  plenty  of  common  sense,  they  can  justly  claim  a  very  strong 
talking  point  for  their  pronouncements.  They  can  be  less  success- 
fully accused  of  sweeping  statements,  of  hasty  conclusions,  and 
of  hobby-riding  than  can  any  other  persons  attempting  to  evaluate 
school  work.  Their  standards  and  procedures  are  often  so  simple 
that  they  can  easily  set  a  pupil  to  measuring  for  himself  his  own 
progress  in  school  work. 

5.  Prestige  of  up-to-dateness. — A  final  talking  point  grows 
out  of  the  fact  that  measurement  work  is  now  generally  regarded 
in  leading  educational  circles  as  one  of  the  earmarks  of  an  up-to- 
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date  school  system.  If  there  is  no  unjust  depreciation  of  the  work 
of  those  who  were  making  careful  quantitative  studies  before  the 
term  "measurement"  came  into  general  use,  this  prestige  value 
can  be  played  up  to  great  advantage.  Teachers  and  communities 
may  be  frankly  somewhat  skeptical  on  many  phases  of  measure- 
ments. But  if  the  suggestion  has  been  skillfully  made  that  those 
opposing  measurement  work  are  thereby  in  danger  of  being 
considered  unprogressive,  many  people  will  hesitate  to  oppose  it. 
Much  of  the  present  vogue  of  measurement  work  undoubtedly 
is  due  to  skillful  exploitation  of  this  particular  prestige  value. 
This  talking  point  of  course  is  more  useful  now  than  it  will  be 
after  some  years. 

III.  Objections 

In  good  business  organizations,  salesmen  are  coached  not  only 
on  talking  points  but  on  all  possible  objections.  They  are  not  to 
bring  up  objections,  but  they  are  to  be  ready  to  utilize  any  that 
may  arise.  The  former  sales  manager  of  the  Ford  Motor  Company 
in  his  books  on  salesmanship  takes  great  pains  to  elaborate  the 
view  that  an  objection  if  real  is  a  sign  of  interest  on  the  part  of  the 
customer.^  Briefly,  the  analysis  runs  thus:  A  possible  customer 
does  not  take  the  trouble  to  object  to  a  thing  which  has  not 
attracted  his  serious  attention.  The  objection  is  a  sign  of  energy 
or  attention  to  the  proposition.  It  is  the  salesman's  business 
by  a  skillful  presentation  of  his  case  to  divert  this  energy  rather 
toward  than  against  the  proposition. 

What,  then,  in  the  mind  of  the  public,  are  the  chief  objections 
to  measurement  work  for  which  the  director  of  measurements 
should  be  prepared? 

1.  Measurement  work  is  too  costly  for  the  results  secured. — 
From  the  available  literature  and  from  fairly  numerous  reports, 
it  is  certain  that  in  the  present  flush  of  enthusiasm  some  measure- 
ment workers  have  forgotten  that  the  public  will  judge  their 
activities  by  the  same  economy  standards  which  they  employ 
in  evaluating  school  work.  Any  well-developed  measurement 
bureau  attempts  to  determine  whether  money  for  schools  is 
economically  spent  and  suitably  apportioned  according  to  the 
importance  of  the  various  phases  of  school  work.  The  taxpayer 
is  easily  interested  in  the  results  of  such  analysis.  He  is  certain 
to  object  to  putting  more  money  into  measurements  until  he  sees 
how  this  measurement  work  appears  under  the  same  kind  of 

*  Hawkins,  Nerval  A.,  The  selling  process,  chap.  x. 
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analysis.  The  measurement  bureau  should  accordingly  be  pre- 
pared to  show  that  its  own  expenditures  are  justified.  It  spends 
some  money  and  it  consumes  time  and  energy  of  both  teachers 
and  pupils.  This  time  and  energy  represent  the  same  cash  value 
when  expended  upon  measurements  as  when  devoted  to  arithmetic 
or  the  keeping  of  school  records.  The  measurement  bureau  must 
be  ready  to  show  better  results  for  such  cash  equivalent  than 
would  have  been  secured  by  the  regular  school  work  that  would 
otherwise  have  gone  on.  If  approximately  the  same  results 
can  be  secured  with  a  twenty-minute  test  as  with  a  forty-minute 
one,  or  with  a  battery  of  tests  instead  of  with  many  different 
tests,  or  if  a  five-cent  test  will  do  instead  of  a  ten-cent  one,  or  if 
the  clerical  labor  involved  in  one  is  only  a  fraction  of  that  needed 
for  a  similar  test,  or  if  a  rough  oral  test  will  sulEfice  for  an  elaborate 
written  one,  the  bureau  should  do  the  economical  thing  and 
advertise  the  fact. 

Sometimes  measurements  produce  only  results  that  any 
careful,  experienced  observer  in  the  system  could  have  secured 
with  a  fraction  of  the  money,  time,  and  energy  necessary  to 
secure  them  through  measurements.  In  such  a  situation  the 
expenditures  for  the  measurement  work  can  best  be  defended  by 
playing  up  impersonality  values  and  uses  for  convincing  incompe- 
tent but  obstinate  teachers  of  their  incompetence. 

It  is,  however,  easy  to  make  out  a  very  strong  case  for  the 
economies  possible  under  the  right  kind  of  school  measurement 
work.  An  examination  of  only  the  first  ten  numbers  of  the 
Journal  of  Educational  Research  and  a  few  other  periodicals 
indicates  such  economies  as  the  following.  To  save  space,  only 
the  volume  and  page  references  are  given.  Unless  otherwise 
specified,  the  reference  is  to  the  Journal  of  Educational 
Research. 

a.  A  much  more  accurate  knowledge  of  individual  abilities 
of  pupils  which  may  be  utilized  to  let  brilliant  pupils  out  of  work 
they  do  not  need  (2:  12,  13);  to  enable  the  teacher  to  know  in 
90  percent  of  cases  just  what  each  pupil  needs  (2:  620) ;  to  detect 
cases  of  shamming  and  laziness  in  pupils  (2:  12);  to  reduce 
failures  in  high  schools  through  superior  guidance  by  teachers 
(1:380);  to  make  more  serviceable  reports  to  parents  as  to  their 
children's  needs  {American  School  Board  Journal,  February,  1921, 
p.  62;  Educational  Review,  59,  p.  346). 
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b.  The  choosing  of  much  better  texts  and  the  paying  of  prices 
necessary  to  secure  suitable  texts  (1:119,  222-24;  2:671). 

c.  Better  time  allotments  for  subjects  (2:736-40). 

d.  The  saving  possible  by  increasing  the  rate  of  speed  in  silent 
reading  (1:136). 

e.  The  actual  cost  of  short  terms  and  poor  teaching  in  rural 
schools  (1:271;  2:636ff). 

2 .  Some  measurement  workers  do  not  seem  to  use  enough  common 
sense. — Friends  of  the  measurement  movement,  to  say  nothing  of 
uninformed  or  hostile  persons,  feel  that  measurement  workers 
sometimes  exhibit  a  great  deal  of  clerical  and  mechanical  activity 
with  insufficient  thought  and  common  sense.  This  is  the  idea 
back  of  Monroe's  observation  that  teachers  often  consider  tests  as 
teaching  devices  and  express  dissatisfaction  that  pupils  do  no  better 
after  them.*  It  was  also  in  the  mind  of  the  intelligent  man  who 
told  Ashbaugh  that  bureaus  of  reasearch  so  far  had  been  simply 
"accounting"  bureaus.* 

Now,  in  ordinary  life  we  object  that  taking  snap  judgment 
is  unfair.  But  all  of  us  know  that  in  some  schools  children  are 
being  assigned  to  grades  or  promoted  largely  on  the  basis  of  one 
brief  intelHgence  test — "in  twenty  minutes  branded  for  life"  as 
one  keen  observer  recently  put  it.  A  capable  school  man  without 
any  direct  knowledge  of  measurements  told  the  speaker  recently 
of  the  case  of  his  two  boys  in  a  school  system  with  which  the  man 
had  no  connection.  Last  year  in  this  system  half-yearly  promo- 
tions were  started.  The  pupils  for  the  higher  sections  were  selected 
by  taking  the  results  of  one  intelligence  test,  given  carefully  under 
expert  supervision  before  Christmas.  On  the  basis  of  this  test  one 
of  the  man's  sons  was  promoted  and  one  held  back.  Later  in  the 
year  another  similar  test  was  given  with  equal  care.  The  ad- 
vanced boy  was  then  pronounced  average  and  the  boy  who  had 
been  held  back  was  then  said  to  be  very  intelligent.  The  father 
has  made  every  allowance  of  which  he  can  think,  but  naturally 
he  wonders  what  it  was  all  about.  A  trained  measurement  worker 
knows  that  occasional  errors  of  this  sort  are  inevitable;  but  it  is 
very  difficult  to  bring  the  ordinary  man  to  this  point  of  view, 
much  less  to  induce  him  to  vote  more  money  for  such  work. 

Common  sense  is  indicated  by  frankly  recognizing  that  there 
are  still  many  phases  of  school  work  where  measurements  cannot 

'Journal  of  Educational  Research,  1:97.  *  Ibid.,  1:421. 
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be  profitably  used.  In  some  cases  they  probably  never  can  be. 
Then,  too,  judgment  needs  to  be  exercised  in  the  applications  of 
results.  Per  capita  costs,  for  instance,  are  very  valuable  in  their 
place,  but  of  little  value  for  final  pronouncements  on  upper  classes, 
new  departments,  or  elective  courses,  especially  in  small  schools. 

In  Wisconsin  we  often  wonder  where  the  common  sense  was 
when  the  recent  Ayres  report  on  state  school  systems  was  compiled. 
The  speaker  has  the  greatest  respect  for  the  high  purpose  behind 
this  great  pioneer  effort  in  educational  research,  as  well  as  for  the 
conspicuous  ability  that  planned  and  executed  the  report;  but 
the  failure  to  use  common  sense  in  some  places  has  materially  less- 
ened the  value  of  the  report  to  us  in  Wisconsin.  From  an  edu- 
cational campaign  standpoint,  nothing  could  be  simpler  than 
employing  the  social  psychology  involved  in  the  fact  that  Wiscon- 
sin ranks  thirty-third  on  this  list  and  state  pride  wishes  her  to  be 
near  the  top  on  any  commendable  list.  But  this  campaign  pro- 
cedure is  impossible  because  careful  readers  of  the  report,  whether 
they  are  school  men  or  not,  are  soon  struck  with  the  fact  that  cer- 
tain important  elements  have  been  altogether  omitted.  The  re- 
port, it  will  be  recalled,  attempts  to  measure  just  two  things, 
attendance  secured  at  public  elementary  and  high  schools,  and 
expenditures  upon  these  schools. 

On  the  attendance  basis  Montana,  the  first  state  on  the  general 
list,  is  credited  with  a  huge  school  enrollment  which  has  been  said 
by  the  United  States  Bureau  of  Education  to  be  largely  due  to 
unusual  immigration  since  the  1910  census.  The  Canal  Zone, 
which  gets  only  one-fourth  of  its  children  into  school,  has  a  higher 
index  by  several  places  than  does  Wisconsin  where  half  the  chil- 
dren are  in  public  schools,  to  say  nothing  of  many  more  in  paro- 
chial schools.  In  the  general  list  Wisconsin,  with  an  illiteracy 
rate  of  32  per  thousand  for  those  ten  years  of  age  and  over,  is 
thirty  places  below  Arizona  which  has  a  rate  of  209  per  thousand 
for  the  same  ages.  From  a  common  sense  standpoint  literacy  in 
these  ages  would  show  about  as  clearly  as  anything  the  real  results 
of  public  school  work. 

Although  half  the  emphasis  in  the  report  is  upon  expenditures 
for  public  elementary  and  high  schools,  any  account  of  money 
spent  upon  training  teachers  for  these  schools  is  omitted.  Thus 
Wisconsin  draws  thirty-third  place  in  the  general  list,  notwith- 
standing the  fact  that,  as  nearly  as  we  can  figure,  she  spent  in  the 
year  considered  more  money  upon  the  training  of  teachers  than 
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the  first  three  (possibly  four)  states  in  the  list  combined,  although, 
taken  together,  they  had  something  like  three  times  her  popula- 
tion and  about  three  times  her  wealth.  From  a  common  sense 
standpoint  such  a  ranking  procedure  is  similar  to  that  of  a  physi- 
cian who  would  attempt  to  pronounce  upon  the  health  of  a  man 
by  examining  only  the  lungs  and  the  digestive  and  excretory  or- 
gans with  no  attention  to  the  heart  or  circulatory  system. 

It  is  only  fair  to  state  that  part  of  the  extraordinary  ratings  as- 
signed to  Wisconsin  came  about  because  of  a  misunderstanding  of 
the  data  in  the  state  reports  to  the  United  States  Bureau  of  Edu- 
cation which  were  used  for  the  report.  Here  common  sense  would 
have  led  one  to  suppose  that  staffs  of  state  departments  of  public 
instruction  lost  the  services  of  members  assigned  to  war  service 
and  had  changes  in  personnel  which  would  make  the  reports  on 
this  period  at  best  somewhat  doubtful.  Common  sense  would 
also  have  avoided  adding  in  the  total  number  of  teachers  for 
Milwaukee  (something  over  10  percent  of  the  teaching  staff  of 
the  state)  while  omitting  in  some  of  the  calculations  all  the  ex- 
penditures for  their  salaries,  which  are  naturally  the  highest  in 
the  state.  Certainly,  common  sense  would  have  suggested  that 
school  data  collected  for  the  year  1918  with  all  the  disruption  of 
school  systems  in  that  year,  ought  to  be  vised  before  publication 
by  the  only  persons  competent  to  eliminate  such  an  error.  If  only 
the  common  sense  device  used  by  Flexner  in  his  study  of  medical 
schools  for  the  Carnegie  Foundation  had  been  used,  much  of  the 
trouble  could  have  been  cleared  up  before  publication.  Flexner's 
study  was  practically  impregnable  because  he  was  able  to  say  that 
his  every  statement  about  a  medical  school  had  been  submitted 
to  the  school  in  question  and  this  school  had  been  given  full  op- 
portunity to  disprove  it  or  to  demonstrate  what  modification  ought 
to  be  made  before  publication. 

It  is  only  fair  also  to  state  that  the  Ayres  report  accomplished 
considerable  good  by  focusing  attention  upon  the  plain  facts  that 
Wisconsin  does  not  spend  enough  money  upon  her  public  schools 
and  does  not  secure  a  good,  enough  school  attendance.  But  the 
failure  to  allow  for  the  elements  mentioned  resulted  in  more  use 
of  the  report  by  politicians,  educational  factions,  and  spiteful 
busybodies  than  by  school  men.**     Had  the  report  been  able  to 

**  Since  this  address  was  delivered,  the  defeat  of  Superintendent  Gary  of  Wisconsin 
for  re-election  in  a  campaign  in  which  this  report  was  extensively  used  against  him, 
furnishes  an  interesting  example  of  the  uses  to  which  such  a  report  may  be  put.  Although 
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withstand  the  common  sense  test,  it  would  have  been  worth  sev- 
eral times  as  much  to  us  in  Wisconsin. 

In  a  recent  number  of  the  Journal  of  Educational  Re- 
search there  appeared 

A  list  of  states  whom  use  of  tests  hath  blest 
And  lo,  Wyoming's  name  led  all  the  rest.' 
As  we  are  always  on  the  watch  in  Wisconsin  to  analyze  the  secrets 
of  success  elsewhere  in  order  that  we  may  better  our  own  work,  we 
looked  into  this  situation.  According  to  the  article  the  states  were 
ranked  on  the  basis  of  "systematic  use  of  standard  tests  in  cities 
of  ten  thousand  population  or  over."  Wyoming  had  a  rating  of 
80  percent  on  this,  counting  five  cities  as  in  this  class.  The  large 
number  of  such  cities  in  Wyoming  seemed  unusual  and  the  back 
of  the  well-known  book  company  calendar  credited  the  state  with 
only  one  city  that  large  in  1920.  Later  it  was  found  that  the  rank- 
ing had  been  made  from  data  given  in  a  previous  article  in  the  same 
journal  by  another  writer  who  had  attempted  no  such  ranking. 
The  latter,  in  addition  to  writing  to  cities  of  10,000  or  over,  sent 
letters  in  the  country  at  large  "to  a  few  cities  of  less  than  10,000 
population  where  there  was  special  reason  for  thinking  that  re- 
search work  had  been  provided  for."  Every  precaution  may  have 
been  taken  to  safeguard  this  procedure  scientifically  so  that  all 
states  would  be  fairly  treated  in  this  supplementary  list.  It, 
however,  resulted  in  adding  four  cities  to  the  original  one  city  of 
Wyoming.  If  additional  cities  for  Wisconsin  had  been  chosen 
on  the  basis  of  the  same  extension  of  census  limits  alone,  at  least 
twenty  additional  cities  would  have  come  in  for  this  one  state. 
The  addition  of  the  small  cities  in  the  manner  used  may  be  ex- 
plained and  possibly  justified  to  trained  measurement  men  save 

carefully  labeled  "An  Index  Number  for  State  School  Systems,"  the  study  was  j)opu- 
larly  known  throughout  the  state  simply  as  "The  Ayres  Report."  The  defeat  of  Superin- 
tendent Cary  by  29,939  votes  in  a  total  of  385,003  appears  in  the  light  of  careful 
inquiry  by  the  writer  to  be  due  to  the  determined  opposition  of  three  groups:  (1)  rural 
taxpayers  disgruntled  over  the  state  superintendent's  condemnation  of  disreputable 
school  buildings  and  his  agitation  for  living  salaries  for  teachers;  (2)  powerful  parochial 
school  organizations  representing  two  faiths;  (3)  manufacturers  who  raised  a  large 
campaign  fund  against  him  because  he  uncompromisingly  opposed  exploitation  of  the 
regular  public  school  system  by  employers  interested  primarily  in  vocational  training. 
No  one  of  these  three  groups  has  ever  been  accused  of  desiring  to  increase  taxes 
for  regular  public  schools  or  attendance  at  them.  Yet  only  by  increases  in  these  two 
items  could  the  state's  standing  in  the  report  possibly  be  raised,  no  matter  who  was  state 
superintendent  or  what  his  policy  might  be.     *  Journal  of  Educational  Research,  3:72. 
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for  the  distortion  liable  to  be  caused  by  running  component  per- 
cents  on  very  small  groups.  But  the  ordinary  man  looking  at 
the  matter  from  a  common  sense  standpoint  is  not  apt  to  see  this. 
In  his  mind,  to  balance  the  addition  of  four  cities  for  Wyoming, 
cities  would  have  to  be  added  by  the  dozen  for  some  other  states. 

The  measurement  movement  is  facing  a  serious  problem  in 
regard  to  the  common  sense  likely  to  be  exhibited  by  many  of  the 
new  measurement  workers.  The  leaders  in  the  movement  so  far 
have  in  the  main  been  men  and  women  of  considerable  actual 
experience  in  teaching  who  later  added  their  measurement  equip- 
ment. They  have  thus  been  able  to  make  valuable  interpreta- 
tions and  applications  of  their  measurements.  Now,  however, 
the  educational  institutions  are  sending  out  many  youngsters 
highly  trained  in  measurement  technic  but  sometimes  woefully 
ignorant  of  the  school  work  which  they  are  attempting  to  measure. 
The  more  gifted  of  these  will,  of  course,  soon  recognize  their  limi- 
tations and  in  time  will  undoubtedly  overcome  this  handicap  by 
hard  work.  But  where  many  of  them  will  get  the  common  sense 
necessary  to  make  their  interpretations  and  pronouncements 
really  valuable  is  indeed  a  problem. 

3.  Too  little  constructive  help  is  given  after  tests. — Probably  no 
experienced  measurement  worker  would  claim  for  a  minute  that 
public  school  systems  should  do  any  measurement  on  their  own 
account  except  for  constructive  supervision.  Some  superinten- 
dents, of  course,  do  measurement  work  in  their  schools  for  their 
graduate  theses;  but  most  of  these  sincerely  believe  that  they  are 
materially  bettering  the  regular  school  work  by  such  studies. 
Every  progressive  school  system  expects  to  share  in  aiding  fruitful 
measurement  research  carried  on  by  the  higher  education  agencies 
in  its  territory.  But  even  here  the  expectation  is  that  the  results 
will  be  sufficiently  valuable  to  the  local  system  to  justify  the  time 
given  to  the  work.  Most  of  the  measurement  literature  in  the 
Journal  of  Educational  Research  stresses  the  view  that 
measurement  is  merely  for  results  whose  interpretations  and 
applications  are  of  material  aid  to  the  schools  tested. 

But  notwithstanding  all  these  good  intentions,  in  altogether  too 
many  cases  the  measurement  work  stops  short  of  giving  the  ex- 
pected help  to  the  schools  tested,  and  certainly  it  stops  short  of 
making  adequate  recompense  for  the  expenditures  on  the  work. 
In  Wisconsin,  for  instance,  in  some  counties  supervising  teachers 
are  devoting  much  of  their  time  to  visiting  teachers  who  are  giving 
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tests.  Then  they  stay  in  the  office  to  work  up  the  results  which 
they  send  to  the  inexperienced  girls  in  the  rural  teaching  positions. 
Much  of  this  work  is  extremely  valuable.  But  the  public  in  many 
places  is  not  yet  convinced  that  it  can  produce  better  results  than 
the  same  time  expended  in  demonstration  teaching  by  the  super- 
visor, in  observing  the  teacher's  work,  and  in  giving  the  latter 
helpful  personal  suggestions  and  criticisms.  From  all  over  the 
country  come  reports  of  so  much  testing  by  some  teachers  that 
insufficient  time  is  left  for  the  actual  teaching.  An  intelligent  and 
progressive  city  superintendent  in  all  sincerity  recently  remarked 
that  he  could  not  see  why  so  much  testing  was  done  for  silent 
reading  work  when  measurement  workers  say  there  is  a  very  high 
correlation  between  silent  reading  ability  and  intelligence.  That 
is,  he  had  not  seen  that  the  testing  had  resulted  in  more  than  say- 
ing that  the  naturally  intelligent  children  would  do  the  best  silent 
reading  anyway.  At  our  Wisconsin  City  Superintendents'  Con- 
vention last  October,  a  very  capable  superintendent,  one  who 
tries  to  keep  up  with  every  school  improvement,  said  publicly  that 
the  testing  for  silent  reading  and  the  emphasis  upon  securing  better 
results  in  it  seemed  likely  to  end  in  dropping  literature  and  the  oral 
reading  necessary  for  the  appreciation  of  poetry  and  the  finest 
prose  almost  wholly  out  of  the  course  of  study.  In  his  thinking 
the  loss  of  an  appreciation  of  literature  could  not  be  offset  by  any 
gain  in  silent  reading  for  mere  information.  At  a  conference  some 
time  ago  a  leading  educator  expressed  doubt  as  to  the  value  of  so 
much  testing  for  promotion  purposes  when  a  very  high  correlation 
has  been  shown  between  the  results  of  good  intelligence  tests  and 
the  opinions  of  competent  teachers  as  to  which  children  should  be 
promoted.  No  doubt  the  skilled  measurement  workers  have  excel- 
lent reasons  for  their  procedure  and  can,  fairly  easily,  answer  such 
objections.  But  the  point  here  is  that  such  objections  from  thought- 
ful people  ought  to  be  guarded  against  in  advance  as  much  as 
possible. 

These  and  similar  observations  of  competent  practical  school 
men  indicate  the  great  work  yet  to  be  done  in  emphasizing  that 
the  interpretation  and  application  of  results  are  of  chief  impor- 
tance. Part  of  the  difficulty  doubtless  arises  from  the  comfortable 
definiteness  of  the  mechanical  processes  involved  in  the  measure- 
ment work.  Most  teachers  are  like  most  people;  they  do  not  care 
for  the  strain  involved  in  what  we  call  creative  or  purely  original 
work.     Interpretations,  applications,  and  definite  outlining  of 
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remedial  measures  form  the  hardest  kind  of  work,  a  kind  actually 
painful  to  many  people.  But  the  tests  are  worked  out  with  such 
explicit  directions  by  the  makers  that  the  giving  of  tests,  scoring, 
and  compilation  of  results  are  routine  work  necessitating  little  real 
mental  effort.  The  teachers  are  perfectly  willing  to  devote  any 
amount  of  time  to  this  and  really  think  they  are  achieving  some- 
thing. Whether  this  is  really  the  case  or  not,  all  measurement 
workers  need  to  measure  their  own  efforts  to  see  what  actual  help 
comes  to  the  schools  from  it.  And  they  will  need  to  convince  the 
public  that  this  help  is  an  adequate  return  for  the  expenditures 
involved.  This  should  be  a  fairly  simple  matter  for  it  seems  only 
reasonable  to  suppose  that  a  measurement  worker  should  be  able 
to  evaluate  and  improve  his  own  work  more  easily  than  can  any 
other  kind  of  school  man. 

4.  The  style  of  presentations  of  measurements  for  the  public  should 
be  radically  different  from  that  for  fellow  measurement  workers. — 
Probably  no  one  would  contend  for  a  moment  that  the  style  ought 
to  be  the  same  for  the  two  groups.  Certainly  the  National  Asso- 
ciation of  Directors  of  Educational  Research  would  not.  They 
have  already  made  a  distinction  between  their  association  meet- 
ings and  their  open  meetings.  They  also  know  that  the  public  as 
a  whole  has  only  about  the  reading  ability  of  a  fifth-grade  child. 
But  the  fact  remains  that  there  are  still  too  many  measurement 
bulletins  and  measurement  sections  of  surveys  which  appear  to 
have  been  written  with  one  eye  on  fellow  workers  and  the  other 
eye  on  the  public.  Such  publications,  unless  very  skillfully  pre- 
sented, can  influence  the  average  taxpayer  only  as  he  has  respect 
for  something  which  he  thinks  is  beyond  him.  Such  an  attitude 
on  his  part  is  not  apt  to  make  him  advocate  more  money  for  the 
work. 

In  this  connection  we  may  take  advantage  of  the  experience 
of  the  United  States  Department  of  Agriculture  and  of  the  various 
university  extension  organizations.  These  long  ago  found  that  the 
style  of  matter  intended  for  the  public  must  be  radically  different 
from  that  for  fellow  scientists.  These  organizations  issue  bulletins 
for  scientists  and  then  interpret  and  explain  the  same  things  in 
public  bulletins  of  a  very  different  nature.  In  educational  work 
there  are  a  few  examples  like  the  publications  of  Dr.  Ayres  for  the 
Russell  Sage  Foundation  which  are  effective  with  both  groups. 
But  in  the  main,  the  practice  of  separate  publications  is  much 
better. 
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Form  elements  in  material  for  the  public  merit  special  em- 
phasis. Presentations  for  the  public  should  translate  statistical 
results  by  taking  advantage  of  ideas  already  understood  by  the 
average  man  and  by  utilizing  purely  local  illustrations.  Many 
people  have  the  essentials  of  statistical  ideas  ready  for  measure- 
ment workers  to  utilize.  Thus  the  speaker  a  year  or  two  ago  ran 
across  an  old  deer  hunter  who  was  talking  of  the  refusal  of  some 
city  hunters  to  wear  red  caps  or  coats.  They  said  it  was  danger- 
ous because  far  more  men  were  shot  who  wore  red  than  who  did 
not.  The  old  hunter  had  the  correct  statistical  idea  when  he  re- 
marked that  because  practically  all  deer  hunters  wore  red,  more 
wearers  of  red  would  be  sure  to  be  shot  anyway.  Again,  in  Bir- 
mingham, Alabama,  years  ago  someone  laid  down  the  regulation 
that  the  passing  mark  in  any  class  was  to  be  10  percent  below  the 
class  average  calculated  from  grades  on  a  scale  of  one  hundred. 
The  author  of  this  rule,  and  all  teachers  following  it,  had  certain 
very  important  statistical  ideas  all  ready  for  measurement  work 
to  start  with. 

Spending  energy  on  translating  measurement  results  into  force- 
ful images  familiar  to  the  local  public  is  profitable  work.  Thus  in 
Wisconsin,  in  securing  support  for  county  training  schools  last 
year,  we  showed  that  the  typical  tax  burden  for  county  support 
was  the  price  of  one  egg  per  thousand  dollars  of  assessed  valuation 
for  each  year.  This  year,  in  order  to  have  finer  divisions,  we  have 
employed  the  price  of  milk  to  the  farmers  at  the  condenseries. 
Thus  we  have  been  able  to  show  that  in  one  very  wealthy  county, 
the  county  training  school  has  cost  the  equivalent  of  one-half  pint 
of  milk  per  thousand  dollars  of  assessed  valuation  for  the  year. 
This  fall  a  Wisconsin  county  superintendent,  in  a  county  where 
many  miles  of  cement  road  are  being  built,  discomfited  the  advo- 
cates of  low  school  taxes  by  pointing  out  that  the  cost  of  rural 
schools  in  his  county  for  the  year  was  just  equal  to  that  of  two 
miles  of  cement  road. 

Time  is  not  available  for  an  extended  treatment  of  other  useful 
matters  of  form,  which  have  been  treated  at  length  elsewhere  by 
the  speaker.'  But  certain  items  merit  listing.  For  public  presen- 
tation, each  statistical  table  should  preferably  express  but  one  idea. 
The  printing  should  be  easily  read  from  one  position.  The  print 
should  be  large  enough  to  avoid  eye  fatigue,  especially  on  the  part 
of  older  and  influential  taxpayers.     The  data  in  tables  should  be 

*  Alexander,  Carter.    School  statistics  and  publicity. 
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shifted  from  an  alphabetical  or  other  purely  arbitrary  arrangement 
so  as  to  bring  out  their  sequences.  Forceful  graphs  and  pictures 
may  be  used  to  illustrate  definite  points  and  should  be  so  labeled 
as  to  be  easily  intelligible  by  themselves.  Material  so  labeled  is 
of  special  value  for  lantern  slides  to  be  used  in  presenting  measure- 
ments at  various  public  meetings.  The  tables  in  the  educational 
reports  of  the  Russell  Sage  Foundation  are  excellent  models  for 
this.  It  is  well  to  note  that  advertisements,  which  often  contain 
statistical  matter,  use  graphs  very  sparingly.  In  much  measure- 
ment publicity  the  best  results  will  probably  be  secured  by  a  series 
of  brief  presentations  issued  at  intervals,  each  fairly  complete  in 
itself  but  forming  an  essential  part  of  a  well-planned  whole.  If 
the  whole  presentation  must  be  printed  at  one  time,  the  conclu- 
sions and  recommendations  should  be  printed  at  the  first  with  the 
extended  proof  in  later  sections.  An  admirable  example  of  this  is 
the  recent  study  by  Dr.  G.  H.  Reavis.^  The  first  twenty-five 
pages  are  very  interesting  and  stimulating  to  the  average  man. 
The  statistical  foundations  for  these  statements,  elaborated  to 
suit  the  most  exacting  statistician,  appear  in  subsequent  sections. 
IV.  An  Underdeveloped  Field 
According  to  an  editorial  by  Terman,  "History  shows  that 
when  poverty-stricken  schools  face  insistent  demands  for  higher 
efficiency  the  result  is  likely  to  be  a  development  along  the  lines 
of  inner  organization,  method  and  procedure. "*  Our  public 
schools  with  their  rapidly  increasing  demands  for  money  are 
in  many  places  poverty-stricken,  or  they  soon  will  be.  On 
all  sides  we  feel  insistent  demands  for  higher  efficiency  in  school 
work.  Measurement  work  will  play  the  leading  r61e  in  the  inner 
development  sure  to  take  place.  But  such  development  at  best 
can  accomplish  little  compared  to  what  may  be  done  if  reasonable 
increases  in  school  support  can  also  be  secured.  Measurement 
workers  are  prepared  as  are  no  other  school  men  to  present  edu- 
cational needs  to  the  public  so  that  better  school  support  may  be 
obtained.  But  the  measurement  energy  so  far  has  mainly  attacked 
problems  of  inner  development.  The  members  of  this  association 
of  course  desire  to  be  true  educational  patriots.  To  attain  this 
wish,  they  must  do  their  fair  share  of  the  fighting  necessary  to  se- 
cure better  school  support. 

^  Factors  controlling  attendance  in  rural  schools.  (Teachers  College,  Columbia  Uni- 
versity, Contributions  to  Education,  No.  108.) 
*  Journal  of  Educational  Research,  1:138. 


SCALE  OF  ATTAINMENT  NO.   2.— AN  EXAMINATION 

FOR  MEASUREMENT  IN  HISTORY,  ARITHMETIC, 

AND   ENGLISH   IN   THE   EIGHTH   GRADE* 

S.  L.  Pressey 
Indiana  University 

I.     Experimental  Definition  of  the  Problem 

The  examination  described  in  the  present  paper  is  the  result 
of  an  effort  to  formulate  a  scale  for  investigating  achievement  in 
the  fundamental  subjects,  in  the  last  year  of  grammar  school.  In 
particular  the  writer  has  been  interested  in  the  possibility  of  com- 
paring, by  means  of  such  a  scale,  graduation  standards  in  differ- 
ent schools  and  school  systems.  There  is,  surely,  need  for  such 
use  of  tests  in  defining  certain  important  school  requirements  and 
standards.  In  reality,  educational  tests  have  been  used  to  a  sur- 
prisingly small  extent  in  connection  with  actual  practice  in  grade 
classification  and  disposition.  In  a  sentence,  the  effort  has  been 
to  devise  an  examination  for  measuring  achievement  in  the  fun- 
damental subjects,  primarily  for  the  purpose  of  defining  final 
grammar-school  standards  in  these  subjects.  The  scale  is  there- 
fore intended  for  use  in  investigating  the  finished  product  of  the 
elementary  school  training.' 

In  the  construction  of  such  an  examination  the  first  considera- 
tion was,  of  course,  as  to  what  might  be  the  fundamental  subjects 
which  should  be  covered.  A  test  in  American  history  and  civics 
appeared  unquestionably  necessary,  A  test  in  mathematical 
reasoning,  or  problem-solving,  also  seemed  essential.  A  test  in 
geography  was  not  included,  as  geography  frequently  does  not 
appear  in  the  eighth-grade  curriculum.  The  real  problem  arose 
in  attempting  to  measure  ability  in  English — in  reading,  literature, 
composition.    In  fact,  the  situation,  as  regards  measurement  in 

*  Studies  from  the  Psychological  Laboratory  of  Indiana  University. 

^  As  Scale  of  Attainment  No.  1  and  the  accompanying  first-grade  reading  vocabu- 
lary scale  were  intended  to  investigate  the  first  steps  in  that  training  (see  Pressey,  L.  W., 
"Scale  of  attainment  no.  1 — an  examination  of  achievement  in  the  second  grade," 
Journal  of  Educational  Research,  2 :572-Sl,  September,  1920;  and  Pressey,  L.  W.  and 
Skeel,  H.  V.  "A  group  test  for  measuring  reading  vocabulary  in  the  first  grade," 
Elementary  School  Journal  21:304-9,  December,  1920). 
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this  field,  was  felt  to  be  so  ill-defined  that  two  considerable  pieces 
of  preliminary  research  were  undertaken,  before  the  final  form  of 
the  examination  was  decided  upon. 

The  first  question  was  as  to  whether  a  test  of  ability  in  silent 
reading  should  be  included  in  this  "battery."  From  one  point  of 
view  such  a  test  was  irrelevant  to  the  problem.  The  aim  was  to 
measure  achievement  in  the  "promotion"  subjects;  and  silent 
reading  did  not  so  function  as  a  recognized  entity  in  the  curricu- 
lum— as  an  explicit  factor  conditioning  a  child's  "passing"  or 
"failing."  But  if  ability  in  assimilative  reading  were  so  perva- 
sively all-important  as  is  sometimes  asserted,  then  recognition  of 
that  fact  in  a  proportional  emphasis  upon  measurement  of  silent 
reading  ability,  in  the  writer's  estimation,  would  appear  desirable. 
A  critical  investigation  of  the  situation  was  decided  upon. 

The  results  of  this  investigation  have  already  been  reported,' 
and  require  only  brief  summary  here.  The  findings  suggested  that 
after  freedom  from  oral  reading  habits  had  once  been  attained, 
ability  in  assimilative  reading  was  largely  specific  to  the  particular 
subject  matter  and  vocabulary  dealt  with.  The  findings  should 
certainly  be  considered  tentative  until  verified  by  other  investi- 
gators; and  it  is  hoped  that  other  workers  may  be  interested  to 
study  the  same  question  with  other  materials,  in  order  to  deter- 
mine the  general  validity  of  these  conclusions.  But  meantime, 
the  conclusions  are  by  no  means  unreasonable.    They  are  quite  in 


»  Pressey,  L.  W.  and  S.  L.  "A  critical  study  of  the  concept  of  silent  reading  ability," 
Journal  of  Educational  Psychology  12: 25-31,  January,  1921.  The  conclusion  is  simply 
that  one  reads  understandingly  in  proportion  as  one  is  familiar  with  the  vocabulary 
used,  and  with  the  general  topic  discussed,  and  is  interested — which  is  surely  plausible 
enough.  And  the  factors  conditioning  the  efl&ciency  of  silent  reading  with  any  type  of 
matter  would  appear  to  be  general  intelligence  and  general  habits  of  attention  and 
methods  of  study.  But  these  factors  are  not  factors  operating  in  assimilative  reading 
merely,  nor  to  be  dealt  with  merely  in  that  context.  And  (the  contribution  of  this 
paper)  these  general  factors  appear  to  be  proportionately  less  important  than  has  us- 
ually been  supposed,  as  compared  with  the  specific  elements  of  vocabulary,  background 
information,  and  interest.  Further,  it  is  these  specific  elements  which  would  seem  most 
readily  dealt  with  by  the  school.  Perhaps  the  writer's  point  of  view  does  not  seem  to 
be,  in  the  last  analysis,  so  different  from  the  usual  understanding  of  the  situation.  But 
in  the  emphasis,  and  particularly  in  the  pedagogical  implications,  there  is  a  decided 
difference.  Especially  is  the  importance  of  developing  an  adequate  reading  vocabu- 
lary stressed,  in  this  reconstruing  of  the  problem.  And  a  different  approach,  in  efforts 
at  measurement  of  the  factors  involved  in  assimilative  reading,  is  suggested. 
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keeping  with  what  is  known  about  the  specific  nature  of  most 
functions.  And,  taken  in  connection  with  the  fact  already  men- 
tioned that  "silent  reading"  has  not  yet  won  explicit  recognition 
in  the  usual  curriculum,  the  findings  seemed  adequate  to  warrant 
the  exclusion  of  a  test  of  "silent  reading  ability"  from  the  exam- 
ination. Instead,  a  vocabulary  test  was  included,  on  the  hypoth- 
esis that  vocabulary  was  an  important  element  in  assimilative 
reading,  that  size  of  vocabulary  might  anyhow  be  highly  correlated 
with  ability  in  "silent  reading,"  and  that  increase  in  size  of  reading 
vocabulary  might  be  considered  one  important  result  (perhaps 
the  important  result)  of  the  work  in  "literature." 

The  second  problem  had  to  do  with  measurement  of  ability  in 
English  composition.  It  would  obviously  have  been  possible  to 
obtain,  as  part  of  the  examination,  a  brief  composition,  as  a  sample 
of  each  child's  ability  in  written  work.  In  fact,  the  first  pla  ■  was 
that  the  last  page  of  the  examination  folder  should  be  left  blank, 
and  that  on  this  last  page  should  be  written  a  composition  which 
should  be  rated  by  the  Willing  scale. ^  But  since  the  examination 
was  intended  primarily  for  extensive  survey  work  and  for  use  by 
teachers,  a  method  which  was  so  laborious  and  so  subject  to  the 
personal  equation  of  the  scorer,  seemed  hardly  practicable.  More- 
over, the  writer  felt  that  certain  factors,  tending  to  make  results 
so  obtained  highly  unreliable,  had  not  been  adequately  investi- 
gated. It  is  known  that  judges  may  differ  strikingly,  in  the  rat- 
ings they  assign  to  a  given  composition,  when  using  any  one  of  the 
standard  scales  for  measuring  merit  in  English  composition.'  But 
very  little  is  known  as  to  the  extent  to  which  different  composi- 
tions written  by  the  same  child  may  vary  in  merit,  according  as 
that  child  might  be  interested  in  one  topic  and  not  in  another, 
might  be  alert  on  one  day  but  weary  on  another,  might  occasionally 
be  distracted  by  chance  circumstances  which  did  not  trouble  at 
other  times. 

*  Willing,  M.  H.  "The  measurement  of  written  composition  in  grades  iv  to  vu," 
English  Journal  7:193-202,  March,  1918;  or  see  Monroe,  W.  S.  Measuring  the  results  of 
teaching,  pp.  235-43. 

'  See  for  instance  Kelly,  F.  J.,  Teachers'  marks  (Teachers  College  Contributions 
to  Education,  No.  66,  1914),  pp.  108-32;  Hudelson,  Earl,  Second  conference  on  edma- 
tional  measurements,  Indiana  University,  1915,  pp.  115-22;  Gordon,  Kate,  "A  class  ex- 
periment with  the  Hillegas  scale,"  Journal  of  Educational  Psychology  9:511-14,  Novem- 
ber, 1918. 
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The  results  of  an  investigation  of  this  problem  will  shortly 
be  published.*  It  need  only  be  said  here  that  compositions  writ- 
ten by  a  given  child  on  different  themes,  at  different  times,  and 
in  different  forms  of  discourse,  may  vary  greatly  in  merit.  And 
when  all  these  factors,  making  for  unreliability,  are  taken  into  ac- 
count, it  appears  that  ratings  by  the  usual  method,  on  a  single 
composition  from  each  child,  cannot  but  be  highly  unreliable  as 
measures  of  the  ability  of  the  individual  child,  and  distinctly  in- 
adequate as  a  basis  for  class  or  school  comparisons.'  Various  tests 
of  ability  in  written  English  were,  therefore,  tried.  And  after 
considerable  experimentation  a  test  of  "good  usage"  in  written 
English,  and  a  vocabulary  test,  were  decided  upon.  These  tests 
in  combination  appeared  to  give  an  excellent  indication  as  to  ability 
in  written  English.  The  correlation  of  the  combined  scores  with 
estimated  ability  in  written  English  was  0.72  for  a  large  eighth- 
grade  class.  They  appeared  also  to  have  considerable  value  for 
diagnostic  purposes;  the  good  usage  test  covered  elements  of 
*'form  value,"  while  the  vocabulary  test  investigated  the  equip- 
ment in  verbal  material,  which  a  child  had  available  for  purposes 
of  expression.  At  least  these  hypotheses  seemed  plausible,  and  the 
tests  sufficiently  valuable  to  be  worth  trial  in  such  an  examination 
as  the  writer  contemplated. 

To  summarize  then :  the  preliminary  experimentation  suggested 
that  a  test  in  American  history,  a  test  in  arithmetical  reasoning, 
a  test  in  reading  vocabulary,  and  a  test  in  "good  usage"  in  written 
English,  should  make  an  examination  giving  a  very  good  appraisal 
of  attainment  in  the  fundamental  subjects,  in  the  last  year  of 
grammar  school.    The  tests  may  now  be  briefly  described. 

•  Pressey,  S.  L.  "A  critical  study  of  the  problem  of  measurement  in  English  com- 
f)Osition,"  to  appear  in  an  early  number  of  the  Journal  of  Educational  Psychology.  The 
correlation  between  merit  in  a  narrative  composition  and  merit  in  a  descriptive  compo- 
sition (as  rated  by  the  same  experienced  judge)  was  0.32;  a  total  of  102  cases,  all  the 
eighth-grade  children  in  a  large  departmental  school,  were  dealt  with. 

^  For  instance,  very  careful  estimates  were  obtained  from  the  teachers  in  English, 
history,  and  geography,  for  the  children  in  the  eighth-grade  class  already  referred  to. 
The  correlations  between  the  average  of  these  estimates,  for  each  child,  and  ratings  on 
the  narrative  composition  made  by  an  experienced  judge,  was  only  0.29!  It  may  be 
argued  that  this  low  rating  was  due  in  large  part  to  the  unreliability  of  the  teachers 
estimates.  However,  the  writer  was  able  (as  will  appear  shortly)  to  obtain,  with  two 
"diagnostic"  tests  in  English,  a  correlation  of  0.72,  with  these  same  estimates,  for  these 
same  children  1 
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II.    The  Tests  and  Certain  Matters  of  Test  Form 

The  directions,  and  first  five  lines,  of  tlie  vocabulary  test  run 
as  follows: 

TEST  I.    READING  VOCABULARY 

Directions. — Below  are  some  statements  such  as: 

To  be  weary  is  to  be:    tired    lazy    dull    quick 

Here  the  word  which  correctly  defines  "weary"  is  "tired,"  so  "tired"  has 
been  underlined.  The  statement  now  reads,  "To  be  weary  is  to  be  tired," 
which  is  true.  In  each  of  the  statements  below  you  have  four  choices  for  the 
correct  word,  in  just  this  way.  One,  AND  ONLY  ONE,  is  right.  This  cor- 
rect word  you  are  to  underline,  just  as  "tired"  is  underlined  in  the  example. 
If  you  cannot  be  sure,  guess.    Work  as  rapidly  as  you  can. 

1.  A  dungeon  is  a  room  in  a:    cathedral    prison    store    museum 

2.  A  gable  is  a  part  of  a:    house    book    feud    cataract 

3.  A  token  is  a:     remembrance    thought     epigram    anecdote 

4.  An  abbot  is  an  officer  of  the:    army    navy    state    church 

5.  A  gnarled  tree  is:     smooth    young    rough    leafy 

The  entire  test  consists  of  forty  such  lines.  The  words  were 
selected  from  the  glossaries  of  three  eighth-grade  readers;  the 
forty  lines  finally  used  were  selected  from  a  large  number  of  such 
lines  tried  in  the  preliminary  experimentation.  The  items  finally 
used  were  arranged  in  order  of  difficulty  and  scaled  on  a  probable 
error  scale. ^ 


'  No  attempt  was  made  at  a  systematic  selection  of  every  tenth  word,  or  otherwise 
so  that  interpretation  in  terms  of  total  vocabulary  might  be  possible.  The  value  as  well 
as  the  legitimacy  of  such  a  procedure  is  surely  doubtful.  In  the  present  instance  the 
first  effort  was  simply  to  pick  words  which  seemed  of  about  the  desired  degree  of  hard- 
ness and  of  some  importance  with  regard  to  one's  literary  vocabulary,  and  which  easily 
combined  into  synonyms  and  confusion  words,  for  the  purpose  of  the  test. 

It  should  be  said  that  each  one  of  the  tests  used  was  made  up  from  a  large  number 
of  items  which  had  been  tried  with  a  large  eighth-grade  class  (composed  of  some  one 
hundred  and  fifty  pupils).  The  form  was  made  up  from  this  first  trial,  was  then  tried 
with  a  second  eighth-grade  class  of  about  the  same  size.  And  the  final  form  is  a  re- 
vision of  this  last  trial.  The  writer  wishes  in  this  connection  to  express  his  indebtedness 
to  Superintendent  E.  E.  Ramsey  and  to  Miss  Mary  Kerr,  Principal  of  the  Bloomington 
Departmental  School,  for  their  cooperation  in  the  preliminary  trial  and  to  Superinten- 
dent E.  W.  Montgomery  and  Miss  Dorothy  Moran,  Principal  of  the  Bedford 
Departmental  School  for  their  cooperation  in  the  further  experimentation  with 
the  tests. 
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The  first  five  lines  of  the  second  test — Good  Usage — were  as 
follows : 

1.  The  boys  have  ran  away.    I've  fell  lots  of  times.    I  rang  the  bell. 

We  was  on  time. 

2.  He  developed  great  speed.    He  is  a  foriegner.    He  gave  me  a  receipt. 

This  is  a  cereal  story. 

3.  The  snow  and  ice  has  melted.^,  I' ve  got  to  go.    I  done  all  of  them. 

Should  I  do  this? 

4.  He  said,  "Come  here!"    He  said  to  "come  quickly".    He  said;  Look 

there!    They  shouted  "Catch  him?" 

5.  She  don't  see  me.     She  was  lying  down.     Donald's  got  my  knife. 

What  does  those  words  mean? 

The  directions  require  the  children  simply  to  find  in  each  line  the 
one  sentence  which  is  in  all  respects  correct,  and  to  underline  this 
sentence.  The  test  consists  of  forty  such  lines.  The  odd-num- 
bered lines  deal  with  errors  in  grammar;  the  even -numbered  lines 
with  mistakes  alternately  in  spelling  and  in  punctuation.  The 
grammatical  errors  were  made  up  from  various  grammar  tests, 
chiefly  from  Charters'  Diagnostic  Tests;  but  Starch's  test  was 
also  used  as  well  as  the  test  material  given  in  Sherwin  Cody's 
"Commercial  Tests  and  How  to  Use  Them"  (World  Book  Com- 
pany, Yonkers,  New  York).  The  misspelled  words  are  from 
"Jones'  Spelling  Demons."  The  punctuation  comes  largely  from 
Starch  and  Cody  with  a  liberal  sprinkling  of  original  items. 

The  third  test  was  the  history  test.    The  first  five  lines  follow: 

1.  The  people  who  settled][in*  Ply mouth*were:_Dutch^  English     French 

German 

2.  The  Quakers  settled   in:   Quebec    Maryland    Vermont    Pennsyl- 

vania 

3.  The    Spaniards   explored    America   chiefly    to   obtain:    furs    gold 

trade  land 

4.  A  colony  made  up  of  debtors  was  founded  in :    Massachusetts    Geor- 

gia    New  Hampshire     Maryland 

5.  The  Indians  who  lived  in  the  western  part  of  New  York  were  called 

Iroquois    Narragansetts    Chippewas    Sioux 

The  children  are  told  simply  to  underline  the  correct  response  in 
each  line.  The  tenth,  fifteenth,  twentieth,  twenty-fifth,  thirtieth, 
and  thirty-fifth  questions  have  to  do  with  the  Constitution  and  or- 
ganization of  the  government.  The  lines  were  made  up  from 
Hahn's  admirable  scaled  series  of  questions  in  American  history," 

»  Hahn  History  Scale  for  grades  7  and  8.    Address  H.  H.  Hahn,  Wayne  State 
Normal  School,  Wayne,  Nebraska. 
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but  with  the  use  also  of  Van  Wagenen's  scales,"*  the  Bell  and  Mc- 
Collum  Scale"  and  with  reference  also  to  a  number  of  standard 
school  histories.  The  proportioning,  through  the  different  periods, 
is  according  to  the  number  of  pages  devoted  to  each  period,  on  the 
average,  in  three  such  histories.  It  should  be  added  that  no  effort 
was  made  to  include  "'thought"  questions;  it  was  assumed  that 
questions  dealing  with  historical  information  would,  indicate  with 
a  considerable  degree  of  satisfactoriness  ability  in  historical  think- 
ing as  well." 

The  first  five  lines  of  the  fourth  test — arithmetical  reasoning — 
are  given  below: 

1.  A  dealer  pays  $18.00  for  9  chairs.     The  amount  paid  for  each  chair 

was:    $3.00    $4.00    $2.50    $2.00 

2.  James  counted  55  animals  in  a  field;  25  were  cows.    The  rest  were 

sheep.    The  number  of  sheep  was:    30    20     25     75 

3.  If  an  arithmetic  and  history  together  cost  $1.25  and  the  history  costs 

75c,  the  arithmetic  must  have  cost:  25c    50c    $1.00    85c 

4.  If  you  are  in  school  5  hours  each  day,  5  days  in  the  week,  the  number 

of  hours  you  spend  in  school  per  week  is:    20     10    25     15 

5.  A  paint  box  costs  65c.    If  I  give  the  dealer  a  half  dollar  and  a  quarter, 

my  change  will  be:     10c     13c    25c    5c 

The  test  consists  of  forty  such  items.  The  directions  are  simply 
to  underline,  in  each  problem,  the  correct  answer.  The  test  covers 
more  or  less  systematically  fractions,  percentage,  interest,  men- 
suration, ratio,  and  proportion.  Again,  the  number  of  items  de- 
voted to  each  one  of  these  topics  is  roughly  in  proportion  to  the 
amount  of  space  devoted  to  them  in  certain  standard  arithmetics. 
Incidentally,  it  should  be  noticed  that  with  this  form  of  present- 
ing arithmetical  problems  ability  in  problem-solving  is  very  largely 
kept  separate  from  mere  skill  in  the  fundamental  operations.  The 
form  of  the  test  would  seem  of  some  interest  as  an  effort  toward 
such  analysis. 

*"  Van  Wagenen  American  History  Scales.  Bureau  of  Publications,  Teachers' 
College,  Columbia  University,  New  York. 

"  Bell,  J.  C.  and  McCollum,  D.  F.  "A  study  of  the  attainments  of  pupils  in  United 
States  history,"  Journal  of  Educational  Psychology,  8:257-74,  May,  1917. 

"  Buckingham,  B.  R.,  "Correlation  between  ability  to  think  and  ability  to  remem- 
ber, with  special  reference  to  United  States  history,"  School  and  Society,  5:443-49,  April 
14, 1917;  "A  proposed  index  of  efficiency  in  teaching  United  States  history,"  Journal 
of  Educational  Research,  1:161-71,  March,  1920. 


366 


JOURNAL  EDUCATIONAL  RESEARCH      Vol.  3,  Wo. 


The  children  are  allowed  seven  minutes  each  on  the  first  and 
third  tests  and  twelve  minutes  for  the  second  and  fourth.  The 
arrangement  of  the  tests  on  the  blank  embodies  a  new  feature  of 
some  interest.  The  second  test  is  on  the  last  page  of  the  four-page 
folder;  the  third  test  is  on  the  second  page;  and  the  last  test  is  on 
the  third  page.  The  blanks  are  passed  out  upside  down,  so  that 
the  children  cannot  read  the  printing  on  the  first  page.  After  the 
blanks  have  all  been  given  out  the  direction  is  "Turn  your  blanks 
around!  Fill  in  your  name,  age  and  grade  at  the  top  of  the  page. 
Now  read  the  directions  for  the  first  test,  and  do  what  they  tell 
you  to  do."  Then  at  the  end  of  seven  minutes  the  examiner  says, 
"Stop!  Simply  turn  your  paper  over,  so.  (Illustrate)  to  the  back 
page.  .  .  . ;  do  not  open  the  folder.  The  test  is  named  Good  Usage. 
Read  the  directions  for  this  test  and  do  what  they  tell  you  to  do." 
At  the  end  of  twelve  minutes  the  examiner  again  says,  "Stop! 
Open  the  blank  at  the  middle  (illustrate)  and  fold  it  back  so  that 
the  history  and  arithmetic  tests  are  outside.  Lay  the  blanks 
down  on  the  desk  so  that  the  history  test  is  up.  Now  read  the 
directions  for  this  test  and  do  what  they  tell  you  to  do."  Such 
handling  of  the  blank,  the  writer  has  found,  gives  quite  as  good 
control  of  timing— prevents  looking  from  one  test  to  another — 
as  printing  alternate  pages  upside  down,  putting  directions  for  the 
next  test  on  the  following  page  with  directions  and  material  sep- 
arated, or  other  elaborate  and  artificial  methods. 

The  blank  thus  consists  simply  of  a  four-page  folder,  each 
page  the  size  of  an  ordinary  typewriter  sheet.  The  blank 
being  thus  simple,  the  materials  are  comparatively  inexpensive.^' 
The  tests  are  essentially  "self-giving."  The  examination  can, 
therefore,  be  given  by  the  average  teacher  without  the  slightest 
preparation  except  that  involved  in  glancing  over  the  folder,  and 
the  accompanying  brief  statement  as  to  timing  and  as  to  handling 
the  folder.  The  examination  is  very  easy  for  the  children  to  take, 
especially  because  of  the  very  high  degree  of  unification.  For 
example,  the  directions  are  essentially  the  same  for  each  test  and 
the  response  is  the  same,  namely,  the  underlining  of  the  correct 
element.  Finally,  the  scoring  is  exceedingly  easy.  The  blanks  are 
inside  out  when  they  are  passed  in  by  the  children;  that  is,  the 

"  The  blanks  with  all  materials  are  now  being  sold  by  the  Department  of  Psy- 
chology, Indiana  University,  at  $1.50  per  hundred. 
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second  and  third  pages,  on  which  are  the  third  and  fourth  tests, 
are  exposed  to  view.  The  third  test  should  be  scored  first,  fol- 
lowed by  the  fourth.  The  blanks  for  each  class  or  room  should 
then  be  put  inside  each  other,  the  whole  set  turned  right  side  out 
and  the  first  and  second  tests  scored.  The  total  score  on  the  ex- 
amination is  simply  the  sum  of  the  scores  on  the  four  tests.  After 
a  little  preliminary  practice  it  is  possible  to  score  the  entire  ex- 
amination and  to  obtain  this  total  score  at  an  average  rate  of  less 
than  three  minutes  per  blank. ^^ 

The  examination  is,  then  (1)  inexpensive,  (2)  easy  to  give,  (3) 
easy  to  take,  (4)  easy  to  score.  These  four  practical  requirements 
for  ready  usableness  are,  the  writer  feels,  distinctly  to  be  con- 
sidered— and  not  sufficiently  considered  in  much  recent  test  build- 
ing. 

Tentative  norms  for  the  total  examination  are  presented 
below  :*^ 


Grade 

No.  cases 

25-percentile 

Median 

75-percentile 

VIII 

VIII-B 

VIII-A 

482 
134 
126 

65.6 
55.1 
68.0 

77.0 
65.3 

78.5 

89.0 
78.0 
89.0 

"  A  word  remains  to  be  said  with  regard  to  the  use  simply  of  total  crude  score,  in 
summarizing  results  on  the  total  examination.  It  is  a  rough-and-ready  procedure,  of 
course;  and  it  over-weights  English  about  60  percent.  But  English  is  important  enough 
to  deserve  to  be  over-weighted.  And  so  far  as  the  rough-and-readiness  is  concerned 
the  writer  feels  very  decidedly  that  any  elaborate  statistical  treatment  in  combining 
such  scores  is  usually  not  worth  the  time  and  trouble  it  takes.  Examinations  in  which 
crude  scores  are  rehandled  as  many  as  six  times  are  now  in  use.  But  such  complicated- 
ncss  increases  at  least  sixfold  the  likelihood  of  error.  There  is  surely  a  question  as  to 
whether  the  original  accuracy  of  the  tests  is  sufficient  to  warrant  such  nicety  of  treat- 
ment. The  writer  once  knew  a  student  who  carried  out  an  elaborate  experiment  in 
which  he  obtained  measurements  on  a  chronoscope  to  thousandths  of  a  second.  And 
the  final  calibration  showed  that  his  chronoscope  was  only  accurate  to  tenths.  Even 
the  best  of  present-day  tests  are  distinctly  unreliable.  Under  the  circumstances,  elab- 
orate exactness  in  the  treatment  of  results  is  simply  statistical  pedantry. 

1*  The  examinations  were  given  in  January,  just  before  mid-term  promotions. 

The  writer  wishes  to  express  his  obligation  to  Superintendents  N.  F.  Hutchison 
of  Huntingburg,  Indiana;  F.  G.  Neel  of  Winamac;  Owen  Neighbours  of  Wabash;  W.  F. 
Vogel  of  Boonville;  A.  D.  Montgomery  of  Edinburg;  and  to  Mr.  E.  E.  Keener,  Director 
of  Measurements  in  the  Richmond  (Indiana)  Schools,  for  their  kind  cooperation  in  ob- 
taining these  data.  The  norms  for  the  A  and  B  grades  separately  are  from  Richmond 
only.  The  data  for  the  eighth  grade  as  a  whole  are  somewhat  heterogeneous,  including 
two  systems  with  yearly  promotions  only,  and  one  system  with  A,  B,  and  C  divisions. 
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For  each  test,  the  medians  in  order  run  as  below: 


Grade 

Test 

Vocabulary 

"Good  Usage" 

History 

Arithmetic 

VIII 
VIII-B 

vm-A 

20.0 
15.8 
21.2 

14.8 
13.0 
15.6 

20.6 
16.7 
20.1 

22.2 
20.4 
22.2 

The  above  norms  for  the  separate  tests,  rather  than  the  total 
scores,  are,  of  course,  the  important  figures. 

III.    The  Uses  of  the  Examination 

The  writer  now  wishes,  very  briefly  indeed,  to  indicate  the 
possible  ways  in  which  such  an  examination  can  be  used. 

1 .  In  the  first  place,  it  may  be  used  to  compare  schools  within 
a  given  system.  The  writer  has  before  him  results  from  a  certain 
school  system,  having  five  ward  schools.  In  "Total  Attainment" 
one  school  shows  only  30  percent  of  its  children  above  the  median 
for  that  city.  Another  school  has  63  percent  above  that  median. 
Surely  the  eighth  grades  in  these  two  schools  are  not  strictly  com- 
parable; nevertheless  these  two  schools  are  in  this  same  system, 
the  two  classes  are  both  eighth  grades,  and  both  groups  are  about 
ready  to  finish  grammar  school  and  to  be  certified  as  ready  for 
high  school.  It  is  further  interesting  to  know  that  the  poorest 
school  is  particularly  deficient  in  history  and  is  comparatively  best 
in  arithmetic. 

2.  Such  an  examination  may  be  used,  in  the  second  place,  to 
compare  different  systems.  Of  two  small  systems  of  compara- 
tively the  same  size,  the  first  system  shows  74  percent  of  its  eighth 
graders  above  the  median  for  the  second  system  (the  seventh- 
grade  median  of  the  first  system  is  almost  identical  with  the  eighth- 
grade  median  of  the  other).  And  it  is  particularly  interesting  in 
this  connection  that  the  poorer  system  excels  the  other  in  arith- 
metic. Apparently  "figuring"  has  been  emphasized  in  the  first 
school  at  the  expense  of  the  less  formal  work. 

3.  However,  a  third  and  much  more  important  matter,  from  a 
practical  point  of  view,  does  not  have  to  do  with  the  averages  or 
central  tendencies  of  the  different  groups  at  all.    The  more  im- 
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portant  questions  are  as  to  what  the  graduation  requirements  of 
these  different  schools  may  be,  as  to  what  they  demand  of  a  child 
if  he  is  to  be  certified  by  them  as  having  completed  the  work  of  the 
common  schools,  and  as  to  how  poor  a  child  must  be  before  he  is 
failed  in  a  given  subject.  These  matters  are,  the  writer  feels,  im- 
portant enough  to  receive  consideration  in  a  separate  study.  They 
involve  an  effort  definitely  to  relate  results  in  tests  with  impor- 
tant school  practices;  and,  incidentally,  they  involve  some  curious 
and  interesting  statistical  problems.  Data  dealing  with  this  mat- 
ter, for  the  eighth-grade  classes  included  in  the  present  study,  will 
be  presented  later. 

Summary 

1.  The  paper  presents  an  examination  for  measuring  achieve- 
ment in  the  "promotion"  subjects,  in  the  last  year  of  the  elemen- 
tary school,  and  for  comparing  graduation  standards. 

2.  Preliminary  investigation  led  to  the  omission  of  any  measure 
of  "silent  reading"  from  the  examination,  and  to  the  attempt  to 
investigate  ability  in  English  composition  by  means  of  tests  in 
vocabulary  and  in  "good  usage"  in  written  English.  Besides  these 
two  tests,  tests  in  American  history  and  arithmetic  reasoning  were 
included. 

3.  Tentative  norms  for  the  examinations  as  a  whole  and  for 
each  test  are  presented. 

4.  Some  data  are  presented  indicative  of  the  usefulness  of  such 
a  scale  (a)  in  comparing  different  schools  within  the  same  system ; 
(b)  in  comparing  different  systems;  and  (c)  in  comparing  gradua- 
tion standards  from  school  to  school  and  system  to  system. 


THE  RELIABILITY  OF  TEST  SCORES 

Truman  L.  Kelley 
Stanford  University 

Many  methods  have  been  used  in  measuring  the  reliability 
of  tests.  By  reliability  is  to  be  understood  the  extent  to  which 
the  test  measures  that  which  it  in  reality  does  measure — not 
necessarily  that  which  it  is  claimed  to  measure.  Each  method 
has  been  followed  because  of  some  feature  of  simplicity  of  use, 
of  interpretation,  of  result,  of  real  or  fancied  accuracy,  etc.  From 
the  variety  of  methods  used,  it  is  plain  that  all  too  frequently  the 
desire  to  secure  a  measure  of  reliability  which  would  be  comparable 
to  measures  obtained  by  other  workers  with  similar  tests  has  been 
absent.  The  methods  indicated  by  the  following  propositions 
have  all  served  more  or  less  successfully. 

Other  things  being  equal,  of  two  tests  designed  to  measure 
some  trait,  that  one  is  the  more  reliable : 

I.  That  gives  a  distribution  of  scores  in  greater  agreement 
with  the  known  or  probable  distribution  of  the  trait; 

II.  That  gives  the  least  overlapping  between  two  groups  of 
individuals  known  to  be  far  apart  in  the  trait ; 

III.  That  correlates  the  more  highly  with  other  independent 
measures  of  the  trait  (this,  of  course,  is  more  than  a  mere  measure 
of  reliability) ; 

IV.  Whose  exercises  are  more  equally  spaced  upon  a  scale  of 
difficulty ; 

V.  That  is  the  longer  (in  the  sense  of  containing  more  examples 
of  the  same  type) ; 

Via.  That  correlates  the  higher  with  a  second  form  of  the 
test  as  similar  to  the  first  as  possible  without  containing  identical 
elements  (self-correlation) ; 

VIb.  That  results  in  individual  scores  whose  probable  errors, 
when  expressed  in  terms  of  a  measure  of  deviation  of  the  group 
examined,  are  the  smaller ; 

Vic.  That  results  in  individual  scores  whose  probable  errors, 
when  expressed  in  terms  of  the  deviation  of  some  standardized 
group,  are  the  smaller ; 
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VId.  That  results  in  individual  scores  whose  probable  errors, 
when  expressed  in  terms  of  the  difference  between  two  standard- 
ized groups,  are  the  smaller. 

Methods  Via,  VIb,  Vic,  and  VId  are  all  dependent  in  the 
sense  that  if  one  is  known  and  the  definition  of  the  group  upon 
which  it  is  based  is  also  known,  then  each  of  the  others  can  be 
obtained.  This,  however,  may  be  a  very  tedious  task,  and  these 
procedures  are  not  of  equal  simplicity  of  interpretation,  so  that 
they  do  not  have  equal  merit  as  measures  of  reliability.  Without 
attempting  an  adequate  discussion  of  each  of  these  nine  methods, 
the  following  brief  observations  are  made. 

I.  This  is  an  entirely  inadequate  method  and  probably  would 
never  be  used  were  not  the  requisite  distributions  available. 

II.  This  is  a  good  method  if  two  tests  endeavoring  to  measure 
the  same  thing  are  to  be  compared,  and  if  the  two  groups  used  in 
determining  the  reliability  of  the  first  test  are  identical  with  (or 
known  to  be  closely  similar  in  talent  to)  the  two  groups  used  in 
the  second  instance.  This  method  is  really  but  another  way  of 
accomplishing  the  end  described  in  VId,  but  it  does  not  permit  of 
the  accuracy  and  objectivity  of  interpretation  and  statement  that 
is  possible  in  the  case  of  the  VId  method. 

III.  If  a  measure  correlates  very  highly  with  known  measures 
of  capacity,  it  must  of  necessity  have  a  fair  degree  of  reliability, 
but  as  the  converse  is  not  true — that  if  a  test  has  high  reliability, 
it  will  correlate  well  with  a  valid  criterion — correlation  with  a 
good  criterion  should  be  used  as  a  measure  of  validity  and  not  of 
reliability.  The  need  of  knowing  the  reliability  of  a  test  has  been 
questioned,  since  the  practical  problem  is  not  primarily  to  secure 
tests  of  high  reliability.  It  is  of  no  import  to  measure  accurately 
some  trivial  capacity,  but  it  is  of  great  moment  to  secure  tests, 
the  scores  in  which  are  highly  reliable  indexes  of  ability  in  some 
known  and  important  capacity.  Expressed  in  statistical  terms, 
if  Tu  is  the  correlation  between  a  test  and  a  sound  criterion,  and 
r\2  the  correlation  between  one  form  of  the  test  and  a  second  form 
(the  usual  reliability  coefficient),  what  matters  the  value  of  rn  if 
r\c  is  satisfactory?  For  purposes  of  accuracy  of  estimating  crite- 
rion scores,  knowing  test  scores,  it  matters  not  at  all  whether 
ri2  is  known  or  not;  but  for  purposes  of  understanding  the  simi- 
larity between  the  functions  measured  in  the  test  and   those 
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involved  in  the  criterion,  ru  must  be  known.  The  highest  possible 
correlation  which  can  be  obtained  (except  as  chance  might  occa- 
sionally lead  to  higher  spurious  correlations)  between  a  test  and 
a  second  measure  is  with  that  which  truly  represents  what  the 
test  actually  measures — that  is,  the  correlation  between  the 
test  and  true  scores  of  individuals  in  just  such  tests.  These 
true  scores  may  be  defined  as  the  average  scores  of  individuals 
upon  a  very  large  number  (an  infinite  number)  of  just  such 
tests.  This  correlation  between  a  single  test  and  the  true  score 
in  the  trait  measured  by  a  single  test  is  equal  to  Vrn  -^  This  is, 
then,  the  maximum  correlation  which  can  ever  be  obtained 
(except  as  a  matter  of  chance)  with  the  test.  If  this  is  low,  it 
frequently  answers  all  the  questions  involved.  If  ri2  =  0.25  so 
that  \/ri2  =  0.5,  it  would  be  ridiculous  to  continue  to  use  the 
test  without  lengthening,  or  otherwise  improving  it,  in  a  problem 
which  requires  for  valid  results  a  much  higher  correlation  with  a 
criterion. 

Again,  suppose  it  has  been  determined  from  a  very  large 
population,  thus  obviating  the  factor  of  chance,  that  Vrn  =0.50 
and  that  fie  =  0.50.  This  exceptional  case,  only  possible  when 
the  criterion  is  perfectly  reliable,  would  mean  that  the  test  score, 
in  so  far  as  it  was  not  due  to  chance,  exactly  paralleled  the  criterion 
in  its  significance.  In  such  case  it  would  only  be  necessary  to 
increase  the  length  of  the  test  to  secure  more  and  more  nearly 
perfect  measures  of  the  criterion. 

Suppose  the  \/n2=0.50  and  ric  =  0.40.  The  interpretation 
of  this  situation  depends  upon  the  reliability  coefficient  of  the 
criterion.  Let  us  first  suppose  that  it  is  perfectly  reliable.  Then 
the  fact  that  ru  is  less  than  0 .  50  is  conclusive  proof  that  some  of 
the  traits  which  are  truly  measured  by  the  test  are  not  identical  with 
elements  of  capacity  involved  in  the  criterion.  These  elements 
(of  habit,  memory,  or  what  not)  should  be  searched  out  and  elim- 
inated or  the  test  will  continue  to  measure  something  in  addition 
to  the  criterion.  This  "thing  in  addition"  could  conceivably 
involve  the  same  elemental  traits  as  the  criterion,  but  not  in  the 
same  proportion. 

Generally,  however,  the  criterion  is  not  one  of  perfect  reliabil- 
ity, so  that  the  interpretation  is  not  so  simple.     If  fcc  is  the  relia- 

*  Kellcy,  Truman  L.  "A  simplified  method  of  using  scaled  data  for  purposes  of 
testing,"  School  and  Society,  4:  34,  71,  July  1,  8,  1916. 
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bility  coeflScient  of  the  criterion,  then  Vcc  ^^  ^^^  maximum 
possible  correlation  with  it  (except  as  a  matter  of  chance).  In 
this  case  the  maximum  value  which  ru  can  have  (this  maximum 
reached  when  no  elements  except  chance  other  than  those  involved 
in  the  criterion  are  involved  in  the  test  score)  is  Vri2'>^Vrcc-  To 
illustrate,  suppose  Tcc  is  equal  to  0.64,  then  \/r^X\/rcc  =  0-40. 
Now,  if  Tic  also  equals  0.40,  then  the  best  results  possible  of 
anticipation  are  obtained;  that  is,  all  the  factors  of  which  the 
test  score  is  a  measure  are  (1)  either  factors  likewise  measured  by 
the  criterion,  or  (2)  chance  factors.  Now,  suppose  ru  is  less 
than  0.40,  say  equal  to  0,30.  With  reliability  coeflScients  as 
given,  namely  ri2  =  0.25  and  rcc  =  0.64,  it  must  be  that  at  least 
to  a  degree  the  test  score  is  not  in  its  significant  portion  merely  a 
measure  of  what  the  criterion  measures. 

It  is  therefore  apparent  that  in  order  to  answer  the  really 
important  questions  in  regard  to  the  test  and  what  it  measures, 
it  is  necessary  to  know  not  only  the  correlation  with  the  criterion, 
but  also  the  reliability  of  the  test  and,  what  is  unfortunately 
seldom  known,  the  reliability  of  the  criterion. 

IV.  This  is  a  very  indirect  measure  of  reliability.  The  princi- 
ple, however,  is  important  in  the  matter  of  the  derivation  of  a 
test. 

V.  This  principle  has  long  been  known  and  widely  used. 
Suppose  there  are  n  similar  tests  and  the  average  score  upon  all 
of  these  tests  is  taken  as  the  score  for  a  single  individual,  then,  if 
f  12  (the  correlation  between  one  of  these  tests  and  a  second)  is 
known,  it  is  possible  to  estimate  the  reliability  coefficient  of  the 
score  which  is  the  average  of  n  tests.  Let  us  designate  this  correla- 
tion between  the  average  scores  upon  n  tests  and  n  other  similar 
ones  by  r„if.  Since  the  particular  n  tests  averaged  to  obtain 
the  first  score  are  different  tests,  though  similar  to  the  same 
number  averaged  to  obtain  the  second  score,  the  correlation  is 
designated  r^  instead  of  r„„,  which  latter  would  imply  that  the 
same  tests  were  given  twice.  The  symbol  r„„  niay  well  stand  for 
the  correlation  between  retestings  with  the  same  material,  whereas 
r„if  is  the  correlation  between  scores  based  upon  similar  material. 
Brown's  formula  gives  r,^  in  terms  of  r^. 

r  ^(^12) 

"^    l+(»-l)f„ 
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n  may  be  integral,  fractional,  greater  than  1,  or  less  than  1.  The 
excess  of  r^  over  r^  measures  the  increase  in  reliability  in  passing 
from  a  single  test  to  another  similarly  constructed  but  n  times  as 
loiig. 

Via.  As  mentioned  in  III,  the  greater  the  self-correlation  of 
a  test  the  more  reliable  it  is.  The  reliability  coefficient  is,  how- 
ever, not  an  entirely  satisfactory  measure  of  reliability,  for  it  s 
affected  by  the  distribution,  in  the  trait  measured,  of  the  particular 
group  studied.  To  secure  a  reliability  coefficient  of  0.40  from  a 
group  composed  of  children  in  a  single  grade  is  probably  indicative 
of  greater,  not  less,  reliability  than  to  secure  a  reliability  coefficient 
of  0.90  from  a  group  composed  of  children  from  the  second  to 
twelfth  grades.  If  it  is  reasonable  to  assume  that  in  terms  of 
true  ability  the  spread  of  talent  is  four  times  as  great  in  the  eleven 
grades  as  in  a  single  grade,  the  correlation  in  the  second  case 
would  need  to  be  0 .  914  in  order  to  indicate  as  close  a  relationship 
as  that  shown  by  a  reliability  coefl&cient  of  0.40  in  the  single 
grade.     The  following  formula^  gives  the  relationship: 

ZL  =  ^r(l-R) 

<^T     VR(l-r) 
at  and  o-j-  are  the  standard  deviations  of  the  two  groups  in  terms 
of  true  ability,  and  r  and  R  are  the  reliability  coefficients  of  the 
two  groups.     Solving  this  equation  for  the  case  in  which  <rr  =  4<r, 
andr  =  0.40,  gives  22  =  0.914. 

If  the  standard  deviations  of  scores  in  two  groups  are  known, 
it  is  not  necessary  to  make  any  assumption;  for  then  the  follow- 
ing formula  applies: 

S  Vl-r" 
In  this  formula  a  and  S  are  the  standard  deviations  of  the 
scores  in  the  two  groups  and  r  and  R  the  reliability  coeflScients 
respectively.  In  passing,  it  may  be  noted  that  this  equation  is 
an  excellent  criterion  for  determining  whether  a  test  is  equally 
effective  in  a  range  S  as  in  another  range  o-;  for  if  the  relationship 
just  given  does  not  hold  within  the  probable  error  of  the  deter- 
mination, it  is  evidence  that  higher  correlation  is  found  in  one 
part  of  the  range  than  in  another. 

*  For  the  derivation  of  this  formula  see  p.  377  at  the  close  of  the  article. 
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In  spite,  therefore,  of  the  very  real  merits  of  the  coefficient  of 
reliability,  it  does  not  permit  of  direct  comparison  in  case  the 
groups  examined  are  of  different  ranges  of  talent. 

VIb.  The  reliability  coefficient  may  be  used  to  determine  a 
probable  error  of  an  individual  score,  and  this  measure  is,  of 
course,  entirely  independent  of  the  range  of  talent  upon  which 
the  calculation  is  based.  It  is,  of  course,  desirable  that  this 
population  be  large  enough  so  that  chance  errors  will  be  small. 
Let  Xi  and  x^  be  the  scores  expressed  as  deviations  from  their 
respective  means  in  two  forms  of  a  test;  ai  and  a^  the  standard 
deviations  of  these  forms  (presumably  practically  equal) ;  and  r la 
their  reliability  coefficient.  Then  if  aji-scores  are  estimated  from 
a^a-scores,  there  will  be  discrepancies  between  the  estimated  Xi- 
scores  and  the  oji-scores  actually  obtained.  These  discrepancie  are 
called  residuals,  or  errors  of  estimate.  The  standard  deviation  of 
them  is  given  by  the  following  equation:'  0-1.2  =  o-iVl—n2^-  The 
probable  error  of  estimate  is  0.6745  <Ti\/'\.—r\2^.  Usually,  however, 
it  does  not  particularly  concern  us  to  know  how  closely  it  is  possible 
to  estimate  r«;x-scores  from  known  a:2-scores.  The  fact  which  we 
particularly  wish  to  know  is  how  closely  we  can  estimate  true 
scores  (true  scores  defined  as  before,  as  the  average  scores  which 
individuals  would  make  if  tested  under  similar  conditions  upon  a 
very  large  number  of  such  forms) .  The  standard  error  in  estimat- 
ing true  scores  from  a;2-scores  is  equal  to  (riVl— n2-  Otis  and, 
more  recently,  Monroe  have  shown  that  this  is  also  equal  to 

-—=■  in  which  crn  equals  the  standard  deviation  of  differences 

v2 

between  -  and  -  scores. 

There  are  thus  two  methods  (one  involving  the  calculation  of 
the  correlation  between  tests  and  the  other  the  calculation  of  the 
standard  deviation  of  differences)  whereby  to  calculate  the 
standard  error  of  estimate.    The  probable  error  of  estimate  is, 

0.6745 


of  course,  0.6745  <j\\/\—r\i  —  — — =-  od.      The  practical  advan- 

V2 
tages  in  measuring  reliability  by  the  smallness  of  the  errors  of 
estimate  lie  in  (1)   their  simple  interpretation,  and   (2)   their 

»  For  the  derivation  of  this  formula  see  p.  379  at  the  close  of  the  articl*. 
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independence  of  range  of  the  talent  examined;  for  if  the  test  is 
equally  excellent  throughout  a  wide  as  a  narrow  range,  except  as 
influenced  by  chance,  <rVl— ri2  for  one  range  equals  "SVl—Rn 
for  a  second  range.  Their  disadvantage  lies  in  the  fact  that  they 
are  dependent  upon  the  units  which  happen  to  be  those  of  the 
test,  and  direct  comparisons  of  different  tests  cannot  be  made. 
If  the  probable  error  of  estimate  in  the  case  of  the  Alpha  reading 
test  is  5  alpha  units,  and  the  probable  error  of  the  Beta  reading 
test  is  20  beta  units,  it  is  not  known  which  is  the  more  reliable 
until  some  equating  of  the  units  has  taken  place.  Two  methods 
of  doing  this  are  here  proposed : 

Vic.  It  is  possible  to  define  a  group  in  such  terms  that  a 
second  investigator  could  approximately  duplicate  it,  for  example, 
"unselected  English  speaking  twelve-year-olds."  If  the  measure 
of  dispersion  of  this  group  (say  its  standard  deviation)  is  taken 
as  the  unit,  and  if  errors  of  estimate  are  expressed  in  terms  of  this 
denominator,  the  reliability  of  tests  claiming  to  measure  the  same 
capacity  can  be  directly  compared  and  the  reliability  of  tests 
measuring  quite  different  capacities  can  probably  be  compared 
with  considerable  validity  and  much  significance. 

VId.  It  is  possible  to  define  two  groups,  for  example  unselected 
children  of  two  different  ages,  and  to  take  the  difference  between 
the  means  of  the  two  groups  as  the  unit.  The  writer  proposed  at 
the  February  1920  meeting  of  the  National  Association  of  Direc- 
tors of  Educational  Research  at  Cleveland  that  the"  difference 
between  the  mean  scores  of  unselected  twelve-year-olds  and 
thirteen-year-olds  be  accepted  as  a  unit,  and  that  the  probable 
error  of  estimate  of  tests  be  expressed  in  terms  of  this  unit.  This 
has  the  very  great  advantage  of  being  easily  interpreted.  If,  for 
example,  the  probable  error  of  the  estimate  of  a  test  is  0.75  in 
terms  of  this  unit,  it  means  that  the  probable  error  of  a  placement 
of  a  child  in  the  capacity  measured  by  the  test  is  0 .  75  of  a  year's 
growth  in  the  case  of  children  twelve  to  thirteen;  and  that  the 
probable  error  is  in  the  neighborhood  of  the  same  amount  in  terms 
of  years  for  children  somewhat  below  or  above  this  age. 

Simplicity  of  interpretation  strongly  recommends  this  method, 
but  inequality  of  rate  of  growth  in  different  capacities  makes 
direct  comparison  of  different  functions  in  terms  of  this  unit  not 
entirely  sound.   Furthermore,  the  probable  error  of  the  determina- 
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tion  of  this  unit  based  upon  a  certain  number  of  pupils  of  ages 
twelve  and  thirteen  would  be  much  greater  than  the  probable  error 
of  a  unit  equal  to  the  standard  deviation  of  a  distribution  of  the 
same  number  of  12 . 5-year-olds,  as  is  apparent  by  reference  to  the 
formulas  for  the  probable  errors  of  these  magnitudes.  The  age 
group  twelve  to  thirteen  is  recommended  because  elementary, 
intermediate,  and  high-school  tests  can  all  be  given  to  this  age 
group,  and  because  probably  as  large  a  percent  of  this  age  group 
are  to  be  found  somewhere  in  the  school  system  as  of  any  age 
group.  Accordingly,  if  all  twelve-year-olds  in  the  school  system 
are  tested,  a  fair  approximation  to  an  unselected  group  is  obtained. 
This  paper  has  been  written  with  a  view  to  showing  the  need 
of  a  standardized  procedure  in  measuring  the  reliability  of  the 
tests  which  are  in  use,  and  with  the  hope  that  it  will  encourage 
such  study  and  discussion  as  will  lead  to  a  unified  practice. 
Whether  the  particular  practice  recommended  is  adopted  is 
secondary  to  the  establishment  of  a  common  procedure. 


DERIVATION  OF  THE  FORMULA 


a-R) 


i?(l-r) 

Consider  two  forms  of  the  same  type  of  test,  each  designed  to  measure 
a  given  ability.  Suppose  that  these  two  forms  have  been  given  to  N  pupils 
whose  range  of  talent  is  narrow  and  to  the  same  number  of  pupils  whose 
range  of  talent  is  wide.  Call  the  measures  obtained  from  the  first  and  second 
forms  (expressed  as  deviations  from  the  mean)  the  aji's  and  iCj's  respectively. 
Then  rn  is  the  correlation  between  the  two  forms,  or  it  is  the  reliability 
coefl&cient.  Call  the  standard  error  of  estimate  of  the  Xi  scores  from  the  true 
scores,  ai.i.    Then  <n.?  =  ax^  (1 — fn).* 

Similarly,  when  the  two  forms  of  the  test  are  applied  to  the  wider  range 
of  talent,  we  may  write  (designating  the  constants  by  capital  letters) 

2i.<«  =  21^(1— i2i2) 
Now,  if  the  test  is  equally  effective  in  the  wide  and  the  narrow  range  of 
talent,  then  the  two  errors  of  estimate  are  the  same   and  ffi./=2i./.    Or, 
ffi*  (1 — fix)  =2;i*(l — iSij).    Whence,  dropping  the  subscripts, 

—  =    , Formula  (1) 

2i     Vl— r 

Now,  suppose  that  instead  of  having  two  forms  of  the  test,  we  have  n 

forms  where  n  approaches  infinity.    Then  the  true  measure  of  the  ability  of 


*  Cf.  derivation  (below)  of  the  formula  <ri.j==aiV  1— r,/ 
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each  pupil  is  the  mean  of  his  score  obtained  from  the  n  forms.    Then  for  N 
pupils  and  n  forms,  we  have  the  following  scheme: 


Pupil 


N 


Scores  Expressed  as  De- 
viations FROM  THE  Mean 


1st 
Form 


Xx' 


Xi' 


X,' 


Xi' 


2nd 
Form 


3rd n'A 

Forms 


Xi-- 


Xj 


Xi' 


Xt' 


x/f         x/ 


Xt^  x»' 


X."  Xn" 


X,"»         X»'° 


«,'^  Xn''' 


X,^  X„^ 


Mean  or  True  Scores 


Xi'  +x,'  +x,'  +... 

...Xn' 

n 

«l"+X,"+X,"+... 

...Xn" 

« 

xi'"-|-a;i"'-|-x,"'4-... 

...Xf^' 

n 

afi'^+X8'^+x»'^+.. 

.  .  .Xn'^ 

n- 


a;i^+a;/+«.^+. 


.x„'' 


Since  the  "mean  or  true  scores"  are  expressed  as  deviations,  the  mean 
squared  deviation  equals  the  sum  of  the  squares  of  these  scores  divided  by  N; 


N.N.N,  N\2 

+  Xi     +X,     + Xn 


Or. .^4[(^^'w+x;+....x,'y^.  ^x. 

J_(^J^.^+        ?£l'  +2SX£,  ^2Sx^.        ^^  n(n-l)  ^^^^^>^ 
iV\  n*        n'      ■*       n*  •»'  «* 


)1 


»'  »' 


,ir('?£!!+la'+. ...S!:^\+/'22«i.  +  .... to  ^(^  terms')! 


But?^=a.«,-|-=a^etC. 

And  SXiX»=iVfxi<ri<ri 
22;xiXj 


Whence  — r;—  =  Irnaiat  and  likewise  for  other  paired  values. 

N 

Hence  «r<'=-i  (ai«+<x,«  +  . . .  .ir„«)+(2fi,<rx«r,+  . . .  .to  -^ —  terms) 
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But  ffi  =<rj  =ffi,  etc. 

Therefore,  »/«  =  -  »(ri*+2ffi'(ri,+ri,+  ...to  ^^^~      terms) 

w(w — 1) 
Since  the  series,  rij+''xi  + to  — - —  terms,  may  be  replaced  by  the 

mean  of  its  terms  times  the  number  of  terms,  o?  =  -\  n<j^+2a^ r —  I 


where  r  is  the  mean  of  the  separate  intercorrelations. 


.rate  intercorrelatior 
Whence  <r^  =  <T^  I  -  +r I 

But  since  n  approaches  infinity,  -  and  -  approach  zero. 

n  n 

Therefore,  <r/'  =  ffi'r. 

By  the  same  reasoning  we  obtain  for  the  wider  range  of  talent,  2<*  =  Si*i?. 

Substituting  the  values  of  <ti  and  2i  as  obtained  from  these  equations  in 

Formula  (1),  we  have 

at 


''l^Jra-R) Formula(2) 

S*     ^R{l-r) 


DERIVATION  OF  THE  FORMULA,  ax.i  =  aiVl—rn* 
This  formula  may  be  derived  as  follows:    Let  Xi  equal  the  dependent 
variable  and  Xi  the  independent  variable.    Then  the  formula  for  estimating 
the  value  of  the  dependent  variable  when  that  of  the  independent  variable 

is  known  is  ici=rij— X2.     (This,  of  course,  is  the  usual  regression  equatioii. 

Xi  is  the  value  of  the  dependent  variable  obtained  from  the  equation.)  Let- 
ting Xi  stand  for  any  obtained  value  of  the  dependent  variable,  {xi — Xi)  is 
the  error  of  estimate.  The  extent  of  this  error  may  be  expressed  as  the 
mean  sum  of  the  squares  of  expressions  like  {xi — Xi) — in  other  words,  by  the 
square  of  the  standard  error  of  estimate.  Calling  this  standard  error  of  esti- 
mate ffi.j,  we  have 


2(«i— xi)* 


.«  — ; 


N 
ga 

N 

2a:i' — 2rii— 1^X1X2  -{-rn^  -^Sa;,' 
a  2  a  2 


But 

Therefore, 
Substitutin 

Therefore, 


2afi«» 

N 

N<ria2 

=ri2 

2«iiCj 

='Nri2a\at 

1X2  its  value,  we  have 

crx.,' 

-ffi*— 2f,jVi*-f-fi,Vi« 

=  <ri«(l-r»«) 

ffi.i 

=.«riVl-fa« 

THE  SCHOOL  BULLETIN' 

Educational  workers  in  every  section  of  the  country  were  not 
only  shocked  but  keenly  disappointed  when  their  eyes  fell  upon 
the  first  page  of  the  December,  1920,  issue  of  the  School  Bulletin 
and  read  these  words:  "This  is  the  final  number  of  the  School 
Bulletin y  This  journal  was  founded  by  C.  W.  Bardeen  of 
Syracuse,  N.  Y.,  forty-six  years  ago,  and  has  been  owned  and 
edited  by  him  since  its  establishment.  It  was  a  successful  and 
influential  educational  journal.  It  was  a  profitable  business  enter- 
prise. There  are  many  who  would  have  paid  well  for  this  paper, 
had  they  been  able  to  purchase  it.  It  would  have  been  a  good 
investment.  Why  did  its  owner  discontinue  it  instead  of  passing 
it  on  into  other  hands? 

The  answer  is  that  the  action  was  thoroughly  characteristic 
of  the  man  who  controlled  it.  The  life  of  the  School  Bulletin 
is  the  life  of  C.  W.  Bardeen  and  the  life  of  Mr.  Bardeen  is  the  life 
of  the  School  Bulletin.  For  nearly  half  a  century  this  journal  was 
a  leading  factor  in  the  development  of  the  public  educational 
system  of  the  state  of  New  York.  Through  this  paper  Mr. 
Bardeen  expressed  his  opinion  upon  the  educational  problems  of 
the  day  and  especially  upon  those  peculiar  to  the  Empire  State. 
The  paper  has  stood  out  prominently  as  an  expression  of  Mr. 
Bardeen's  individual  judgment  on  educational  problems.  His 
policy  has  always  been  to  support  educational  measures  and 
reforms  which  he  believed  would  improve  educational  practice 
and  procedure.  When  he  favored  a  proposition  he  gave  it  whole- 
hearted support.  When  he  opposed  a  measure  he  was  equally 
whole-hearted  in  its  condemnation.  He  maintained  the  same 
attitude  toward  men  which  he  did  toward  measures.  When  he 
believed  in  a  man,  his  support  of  that  man  was  assured  and 
proved  a  source  of  great  strength.  His  censure  of  men  in  whom 
he  did  not  believe  was  as  severe  as  his  pen  could  indite. 

*  At  our  request  Doctor  Thomas  E.  Finegan,  State  Superintendent  of  Publi 
Instruction  of  Pennsylvania,  contributed  this  fine  editorial  on  the  passing  of  a  periodi" 
cal  whose  long  and  influential  career  made  its  discontinuance  an  event  in  educational 
history. 
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Mr.  Bardeen's  educational  philosophy  was  sound.  He  could 
be  counted  upon  the  right  side  of  every  great  question.  The 
School  Bulletin  will  prove  to  be,  in  the  years  that  follow,  the  most 
authoritative  source  on  the  history  of  education  in  the  state  of 
New  York  that  will  be  found.  This  journal  has  made  a  large 
contribution  to  the  development  of  American  education.  That 
contribution  is  Mr.  Bardeen's  individual  achievement.  He 
evidently  wanted  that  achievement  to  stand  as  a  memorial  to 
his  service.  He  refused  to  commercialize  it.  He  is  right,  and 
should  be  commended  for  his  decision.  It  required  courage,  but 
of  all  the  numerous  qualities  in  his  character  there  was  none  more 
characteristic  than  his  courageous  spirit.  The  last  issue  of  the 
Bulletin  is  proof  of  this  fact. 

The  Bulletin  will  be  missed  by  thousands  of  teachers  to  whose 
interests  it  was  devoted.  Its  editor's  versatility  and  sense  of 
humor  made  the  paper  a  professional  companion.  The  editor 
put  much  of  his  philosophy  of  life  into  the  paper  and  in  this  way 
cheered  and  encouraged  thousands  of  teachers  when  the  loads 
which  they  were  carrying  seemed  almost  overwhelming.  The 
writer  recalls  a  time  many  years  ago  when  he  had  nearly  decided 
to  abandon  educational  work,  but  the  persuasive  arguments  of 
Mr.  Bardeen  induced  him  to  remain  in  it. 

Having  known  Mr.  Bardeen  intimately  for  more  than  twenty- 
five  years  and  having  read  the  School  Bulletin  religiously  for 
thirty-six  of  the  forty-six  years  of  its  existence,  I  am  able  to  place 
an  appreciation  upon  its  service  and  to  express  an  estimate  of 
the  loss  which  the  readers  of  the  Bulletin  will  feel  in  the  discon- 
tinuance of  this  live,  interesting,  and  helpful  journal.  I  can 
also  assure  Mr.  Bardeen  of  the  appreciation  which  men  throughout 
the  Union  have  of  his  service  to  public  education  and  the  sym- 
pathy and  regret  that  they  feel  for  the  injury^  which  came  to  him 
and  which  makes  it  necessary  to  unload  part  of  the  burdens  of 
his  active  and  busy  life.  His  philosophy  is  so  sound  and  sane  and 
is  so  well  expressed  in  a  personal  letter  which  I  recently  received 
from  him  that  I  have  obtained  his  permission  to  quote  the  follow- 
ing from  that  letter: 

*  In  October,  1920,  Mr.  Bardeen,  who  is  seventy-three  years  of  age,  suffered 
an  injury  to  his  right  foot  which  necessitated  amputation  below  the  knee.  The  letter 
to  Doctor  Finegan,  a  portion  of  which  is  quoted  below,  was  written  in  February, 
when  Mr.  Bardeen  was  convalescing  after  the  operation. 
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"After  six  weeks  in  the  hospital  I  have  got  back  home,  with 
a  range  at  present  of  the  chair  and  the  bed.  But  this  losing  a 
foot  is  not  so  serious.  I  reflect  a  dozen  times  a  day  how  much 
worse  it  would  have  been  to  lose  a  hand,  and  appreciate  more 
and  more  how  fortunate  I  am  that  it  is  below  the  knee.  In  college 
the  boys  used  to  sing: 

'Saw  my  leg  off, 

Saw  my  leg  off, 

Saw  my  leg  off — 

Short!' 
Like  many  undergraduate  ambitions  this  showed  lack  of  sagacity; 
it  is  much  better  to  have  it  cut  off  long. 

"I  keep  getting  astonishing  information  as  to  similar  losses 
that  are  unsuspected;  the  president  of  the  City  Bank,  for  instance, 
whom  I  know  well  and  who  never  limps  or  carries  a  cane,  has  a 
wooden  foot.  I  am  promised  my  own  artificiality  shall  be  equally 
unnoticed,  but  unfortunately  I  can't  get  it  attached  until  the 
skating  season  is  over.  There  has  been  no  pain  worth  speaking 
of,  and  though  a  hospital  bed  is  tedious,  since  I  have  been  allowed 
to  sit  up  and  read  I  have  been  quite  comfortable,  have  had  a 
good  appetite,  and  am  so  well  that  the  doctors  agreed  the  other 
day  that  the  rest  had  done  me  good  and  that  I  was  the  better  for 
the  operation.  However,  when  I  asked  them  if,  when  it  did  me 
so  much  good  to  have  one  foot  off  they  advised  me  to  saw  off  the 
other,  they  did  not  respond." 

A  BOOK  OF  INTERVIEWS 

The  Book  of  Cases  which  was  recommended  by  the  editor  in 
the  January  issue  as  a  means  of  studying  methods  of  teaching 
is  valuable.  But  cases  observed  and  recorded  with  the  care  which 
he  outlines  are  difficult  to  obtain.  So,  in  the  meantime,  I  propose 
a  book  of  interviews  which,  while  not  as  accurate  as  the  case 
reports,  will  be  of  value  as  suggestions  for  the  improvement  of 
methods  of  teaching. 

Teachers  are  much  more  willing  to  tell  what  they  do  than 
to  describe  it  on  paper.  In  every  school  system  there  are  enough 
good  methods  to  provide  the  inexperienced  teachers  with  all  they 
can  use,  methods  which  under  normal  conditions  are  buried  in 
the  individual  minds  of  the  teachers  who  use  them  and  are, 
therefore,  wasted  so  far  as  everyone  except  the  owner  is  concerned. 


May,  1921  EDITORIALS  383 

Through  the  interview  these  methods  become  the  common 
property  of  the  system,  for  by  the  process  of  pooling,  the  indi- 
vidual possessions  of  each  become  the  common  property  of  all. 

The  plan  of  collection  is  very  simple.  It  consists  of  four 
steps.  First,  the  difficulties  which  teachers  have  must  be  selected 
with  great  care  on  both  a  quantitative  and  qualitative  basis. 
It  is  important  that  these  difficulties  be  made  as  specific  as 
possible;  and  it  is  better  to  have  the  difficulties  expressed  in 
terms  of  the  seventh  grade  or  of  the  first  grade  than  in  general 
terms  of  the  whole  elementary  school. 

The  second  step  is  to  select  thirty  or  forty  of  the  best  teachers 
in  the  system  who  have  successfully  handled  the  selected  diffi- 
culties. Here  again  seventh-grade  teachers  and  first-grade 
teachers  should  be  selected  in  connection  with  the  seventh-grade 
problems  and  first-grade  problems. 

The  next  thing  of  importance  is  to  train  interviewers  and 
detail  them  to  find  out  and  record  how  these  successful  teachers 
correct  the  difficulties  in  question. 

Finally,  the  answers  to  each  of  the  questions  should  be  com- 
piled and  in  such  a  way  as  not  to  lose  the  details.  By  such 
methods  it  is  entirely  practicable  to  obtain  a  number  of  valuable 
suggestions  upon  any  topic  upon  which  teachers  have  had  expert 
experience. 

These  collected  methods  do  not  always  have  the  certainty  of 
established  results;  and  occasionally  different  teachers  use  oppos- 
ing methods.  But,  in  some  cases,  the  situation  in  which  one 
teacher  follows  a  method  may  not  be  identical  with  other  situa- 
tions in  which  it  is  desired  to  use  it.  Again,  a  teacher  may  tell 
what  he  thinks  rather  than  what  is  the  case,  or  what  he  ought  to 
do  rather  than  what  he  does.  It  must  also  be  assumed  that 
since  the  methods  are  not  evaluated  they  are  to  be  used  as  sug- 
gestions and  not  as  established  methods  of  procedure.  But  in 
spite  of  these  shortcomings  the  collective  experience  of  the  best 
teachers  in  attacking  a  problem  presents  a  mine  of  suggestions 
which  are  not  all  found  in  books.  These  methods  are  particularly 
valuable  because  they  meet  the  concrete  difiiculties  of  the  school 
room  in  concrete  ways  and  are  described  by  teachers  in  the 
vocabulary  of  the  schoolroom. 

w.  w.  c. 
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THE  EDITORIAL  BOARD,  OR  WHO  CHANGED 
THE  FRONT  COVER 

Our  Editorial  Board  has  engaged  attention  recently  through 
its  tendency  to  change  itself.  More  recently  and  somewhat 
consequently  we  have  been  obliged  to  consider  the  topic  suggested 
in  the  second  part  of  our  title. 

We  alluded  in  our  News  Department  some  months  ago  to  the 
fact  that  Doctor  Ayres  had  withdrawn  from  the  directorship  of 
the  department  of  education  of  the  Russell  Sage  Foundation. 
We  hoped  at  that  time  that,  although  he  was  taking  up  financial 
work,  his  interest  in  education  would  seem  to  him  to  justify  his 
continuing  as  an  associate  editor  of  the  Journal  of  Educational 
Research.  After  taking  the  matter  under  advisement,  however, 
he  decided  to  resign.  As  a  member  of  the  board  of  editors.  Doctor 
Ayres  was  particularly  interested  in  the  field  of  child  accounting. 
His  resignation,  therefore,  left  an  important  department  of  edu- 
cational investigation  without  adequate  editorial  supervision. 
At  this  juncture,  however,  Professor  E.  J.  Ashbaugh,  who  is 
already  a  member  of  the  board  by  virtue  of  his  office  as  Secretary 
of  the  National  Association  of  Directors  of  Educational  Research, 
consented  to  give  such  attention  to  child  accounting  as  might  be 
required.  We  are  very  fortunate  in  securing  the  services  of 
Doctor  Ashbaugh  for  this  purpose,  and  we  feel  sure  that  his 
willingness  to  assume  double  duty  will  be  appreciated  by  our 
readers.  Perhaps,  however,  those  who  are  not  members  of  the 
research  association  do  not  realize  the  extent  of  Doctor  Ashbaugh's 
activities.  We  feel  justified  in  suggesting  to  such  persons  that 
they  look  at  the  last  few  pages  of  each  number  of  the  Journal 
and  observe  the  competent  way  in  which  the  department  devoted 
to  the  association  is  being  conducted. 

As  we  announce  the  resignation  of  Doctor  Ayres  and  the 
assumption  of  the  department  of  child  accounting  by  Doctor 
Ashbaugh,  we  also  desire  to  announce  that  Doctor  Guy  M. 
Whipple,  Director  of  the  Bureau  of  Tests  and  Measurements 
of  the  University  of  Michigan,  has  accepted  an  invitation  to 
become  a  member  of  the  Editorial  Board.  As  to  a  specialty, 
Doctor  Whipple  will  naturally  have  something  to  do  with  tests; 
and  so  far  as  he  does  this,  he  will  add  his  efforts  to  those  of  Doctor 
Monroe  and  Doctor  Terman  in  this  field.  In  a  more  general 
sense  Doctor  Whipple  will  undoubtedly  bring  strength  to  the 
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Journal.  His  large  editorial  experience  in  connection  with 
other  journals  and  as  secretary  of  the  National  Society  for  the 
Study  of  Education  gives  him  a  peculiar  fitness  for  this  type  of 
work.  The  Journal  is  exceedingly  fortunate  to  be  able  to 
enlist  the  services  of  Doctor  Whipple. 

But  we  are  neglecting  our  second  topic.  What  we  started 
out  to  say  was,  "Have  you  seen  our  new  cover  page?"  Perhaps 
not.  We  suspect  that  a  rather  large  proportion  of  our  readers 
may  belong  to  the  tribe  of  the  unobserving — to  the  domestically 
unsatisfactory  clan  who  fail  to  notice  a  new  rug  on  the  living- 
room  floor  or  new  dishes  on  the  dining  table.  If  you  belong  to 
this  clan,  we  fancy  you  will  now  turn  back  and  note  our  new 
spring  attire.  However,  we  wish  to  express  the  hope  that  we 
shall  have  no  more  changes  in  our  Editorial  Board.  The  members 
of  the  board  will  naturally  suppose  this  is  because  we  value  their 
services.  Such  is  indeed  the  case,  but  we  ask  them  to  consider  the 
fact  that  another  resignation  will  necessitate  another  plate. 
Although  the  present  changes  have  given  us  a  chance  to  make 
a  new  appearance,  we  hope  the  members  of  the  board  as  it  is  now 
constituted  will  stay  with  us  indefinitely  if  for  no  stronger  reason 
than  to  save  the  expense  of  engraving  the  names  of  their  successors. 

B.  R.  B. 


S^m^ma  an6  AbatrartH 

E.  H.  Cameron,  Editor 


Burgess,  W.  Randolph.    Trends  of  school  costs.    New  York:  Rusiell  Sage  Founda- 
tion, 1920.     142  pp. 

This  monograph  shares  with  the  monograph  of  Dr.  Ayres  on  An  Index  Number 
for  State  School  Systems  a  distinct  position  in  the  development  of  educational  inquiry. 
Dr.  Burgess'  problem  is  evidently  to  give  some  fundamental  information  concerning 
the  amount  of  increase  which  ought  to  be  made  in  school  budgets  in  order  to  secure 
the  same  amoimt  of  educational  service  as  was  obtained  in  years  just  prior  to  the 
World  War.  In  order  to  do  this  he  brings  to  bear  the  history  of  costs  upon  the  problem. 

Historical  statistics  are  relatively  new  in  education.  Experience  in  that  field 
has  not  been  recorded  in  quantitative  form  asnd  under  uniform  classifications  for  a 
long  period  of  years.  Accordingly,  the  important  lessons  which  may  be  derived  from 
"trends,"  as  Dr.  Burgess  happily  calls  them,  have  been  confined  to  those  fields  in 
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which  practical  workers  as  well  as  investigators  early  saw  the  need  for  systematic 
record-making.  In  economics,  for  example,  we  are  able  to  trace  the  development  of 
the  volume  of  imports  and  exports  in  various  countries,  the  fluctuations  of  wealth 
and  taxation,  the  variations  in  birth,  marriage,  and  death  rates,  the  mutations  of 
exchange  rates  and  bank  clearings,  because  practical  business  or  the  laws  of  civilized 
countries  have  a  long  time  demanded  that  these  data  be  reported  in  comparable  form. 
If  it  is  profitable  in  business  to  know  the  fundamental  facts  underlying  business 
conditions  and  to  know  them  in  a  time  series,  it  is  no  doubt  equally  important  to 
know  in  the  same  way  the  fundamental  facts  underlying  education.  In  addition, 
therefore,  to  the  definite  and  helpful  facts  which  Dr.  Burgess  brings  out  in  his  book, 
we  note  with  pleasure  the  success  he  has  had  in  bringing  to  light  a  few  significant  items 
on  which  he  can  furnish  evidence  over  a  long  period  of  time.  In  the  first  place,  he 
shows  the  fundamental  facts  of  children  in  attendance  and  of  expenditures  for  educa- 
tion in  the  public  schools  of  the  country  since  1870.  He  brings  out  graphically  the 
development  of  these  items  in  this  half  century  by  means  of  trend  lines,  or  lines  of 
closest  fit  to  the  detailed  curve. 

Observing  that  expenditures  for  salaries  (including  wages)  and  outlays  for  sites, 
buildings,  and  equipment  constitute  about  80  percent  of  the  total  school  expenditures, 
and  that  salaries  alone  constitute  nearly  two-thirds  of  the  total,  he  concludes  that  the 
investigation  of  the  trend  of  salaries  is  decidedly  the  most  important  investigation  in 
school  expenditure.  He  is  able  to  carry  this  inquiry  over  a  period  of  80  years,  using 
quotations  (twenty  per  year)  for  the  same  localities.  During  this  period — 1841  to 
1920 — weekly  salaries  increased  as  follows:  for  men  teachers  in  rural  schools,  from 
$4.15  to  $26.75;  for  women  teachers  in  rural  schools,  from  $2.51  to  $17.68;  for  men 
teachers  in  city  schools,  from  $1 1 .  93  to  $60 .  61 ;  and  for  women  teachers  in  city  schools, 
from  $4 .  44  to  $35 .  61 .  During  the  past  five  years  teachers'  salaries  (all  types  of  service 
combined)  have  increased  45  percent.  These  increases  are  large,  but  as  a  matter  of 
fact,  they  substantially  parallel  the  increases  during  the  past  five  years  for  laborers 
and  artisans. 

On  the  basis  of  the  weekly  budget  of  a  typical  wage-earner's  family  the  curve  for 
the  cost  of  living  was  plotted  for  the  same  period.  From  about  1875  to  1915  teachers' 
salaries  were  a  little  above  the  cost  of  living.  From  1915  to  1920  the  situation  was 
reversed,  and  the  cost  of  living  not  only  passed  the  teachers'  salaries  but  increased 
twice  as  rapidly.  "In  1918  and  1919  the  teacher  could  buy  fewer  of  the  necessities 
of  life  than  at  any  time  in  40  years.  The  situation  is  improved  in  1920  but  the  same 
statement  may  still  be  made  truly.  The  considerable  advances  in  teachers'  salaries 
within  a  year  have  thus  far  brought  them  back  only  about  two-thirds  of  the  distance 
that  they  fell."  The  author  adds,  "There  seems  good  reason  ....  to  believe  that 
adequate  adjustment  to  new  price  levels  will  be  made.  It  should  be  realized,  however, 
that  only  a  good  beginning  has  been  made  in  effecting  that  adjustment.  The  major 
part  of  the  task  is  still  to  be  carried  through." 

With  further  reference  to  the  relation  of  the  salaries  of  teachers  to  the  wages  of 
artisans  and  laborers,  the  author  points  out  that  since  1915  the  average  wage  of  artisans 
and  laborers  has  increased  twice  as  much  as  that  of  teachers,  and  that  "in  relation  to  the 
laborer  the  average  woman  teacher  was  in  1918,  1919,  and  1920  less  well  off  financially 
than  at  any  other  time  since  the  Civil  War."  It  is  thus  evident  that  from  the  two 
important  points  of  view  of  cost  of  living  and  the  wages  of  other  workers,  the  standard 
of  living  among  teachers  is  not  as  high  relative  to  that  of  others  in  gainful  occupations 
a$  it  has  been  in  the  past. 
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Dr.  Burgess  also  investigated  the  trend  of  building  costs.      Summarizing  his 
findings,  he  concludes  that  "in  spite  of  considerable  economies  school  buildings  .  .  . 
are  actually  costing  fully  three  times  as  much  as  before  the  war." 

Thus  the  author  brings  from  afar  an  overwhelming  weight  of  evidence  to  bear  upon 
his  conclusion,  which  is  essentially  that  "the  same  items  of  school  expenditure  will  cost 
roughly  twice  as  much  in  1920  as  in  1915."  He  notes  in  this  connection  that  this 
statement  "does  not  allow  for  any  increase  in  school  efficiency,  or  in  school  accommo- 
dations." He  might  have  added — and  did  in  fact  imply — that  it  does  not  allow  for 
any  increase  in  school  population.  On  the  point  of  whether  prices  and  wages  will  fall 
the  author  had  recourse  to  his  experience  sheets  as  developed  for  the  past  80  years. 
He  observes  that  after  the  Civil  War  prices  receded  very  slowly,  and  concludes  that 
we  may  expect  some  lowering  of  price  levels  within  the  next  few  years  "but  no  return 
to  pre-war  conditions  for  many  years  if  at  all."  As  to  wages  and  salaries  he  shows 
that  after  the  Civil  War  "some  wages  receded  a  little  but  only  after  several  years" 
and  points  out  that  "wages  and  salaries  retain  advances  made."  "At  present,"  he  says, 
"it  is  reasonably  certain  that  a  new  salary  level  has  been  reached  which  is  likely  to  be 
permanent.  The  experience  of  the  past  supports  this  reasoning,  and  today  the  factors 
making  for  the  permanence  of  salary  and  wage  increases  are  more  powerful  than  ever 
before."  His  conclusion,  therefore,  that  school  budgets  must  be  double  the  size  of 
those  of  1915  errs,  if  at  all,  on  the  side  of  conservatism. 

As  to  the  way  in  which  this  is  to  be  done,  Dr.  Burgess  has  an  exceedingly  interest- 
ing final  chapter  entitled  "Sources  of  Income."  He  points  out  that  other  sources  of 
revenue  than  general  property  tax  are  either  relatively  non-productive  or  have  been 
utilized  as  far  as  safety  permits.  Moreover,  he  asserts  that  present  needs  cannot  be 
met  by  adjustments  in  city  budgets.  Other  types  of  public  service  "cannot  give  way 
further  for  the  expansion  of  education."  It  is  his  judgment  not  only  that  the  real 
estate  tax  is  the  soundest  provision  for  revenue  but  that  in  spite  of  large  increases  in 
the  tax  rate  in  recent  years,  there  are  no  indications  that  the  limit  which  real  property 
can  bear  has  been  reached. 

We  find  Dr.  Burgess'  book  not  only  distinctive  in  its  treatment  of  educational 
data  but  timely  in  the  lessons  it  draws  from  the  past  for  our  guidance  in  the  present. 

B.  R.  B. 

Proceedings  of  the  High  School  Conference  of  1919.     (University  of  Illinois  Bulletin 
Vol.  XVII,  No.  13)  Urbana,  lUinois,  1920.   313  pp. 

A  review  of  the  Proceedings  of  the  High  School  Conference  of  November  20,  21,  and 
22,  1919  probably  seems  to  be  somewhat  late.  However,  the  unusual  merit  of  a 
number  of  the  contributions  to  secondary  education  recorded  in  the  1919  Proceedings 
justifies  the  publication  of  some  comments  at  this  time. 

Professor  H.  A.  HoUister,  director  of  the  conference,  opened  the  1919  session  with 
a  discussion  of  the  general  conference  objective,  "The  Universalization  of  High  School 
Education  for  the  Children  of  All  the  People  in  Illinois."  During  the  past  few  months 
there  has  been  a  great  deal  of  discussion  of  the  importance  of  high-school  objectives 
as  a  means  of  assisting  in  curriculum  reconstruction.  A  commission  appointed  by  the 
National  Education  Association  has  set  forth  in  a  bulletin  entitled  "Cardinal  Principles 
of  Secondary  Education"  seven  main  objectives:  health,  command  of  fundamental 
processes,  worthy  home-membership,  vocation,  citizenship,  worthy  use  of  leisure,  and 
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ethical  character.  Serious  students  of  the  problems  of  curriculum  reconstruction 
will  be  interested  in  comparing  with  these  seven  objectives  the  four  ultimate  objectives 
proposed  to  the  conference  by  Mr.  Sandwick's  committee,  namely,  health,  wealth, 
association  and  beauty,  the  fundamental  essentials  to  economic,  political,  and  social 
Ufe. 

Probably  the  real  life  and  spirit  of  the  conference  is  developed  in  the  section 
meetings.  Certain  it  is  that  that  part  of  the  1919  Conference  Proceedings  devoted  to 
"Section  Meetings"  is  unusually  full  of  valuable  contributions.  In  practically  every 
section  considerable  attention  was  given  to  the  discussion  of  the  value  of  objectives 
as  a  means  of  curriculum  reconstruction. 

In  the  Administrative  Section  Mr.  A.  G.  Capps,  University  of  Illinois,  presented 
an  excellent  article  on  the  technic  of  curriculum  construction.  Seven  general  rules, 
formulated  by  Dr.  Charters,  were  set  forth  as  guiding  principles.  Mr.  Capps  has 
presented  in  his  paper  an  analysis  of  the  four  ultimate  objectives  of  secondary  educa- 
tion as  set  forth  by  Principal  Sandwick's  committee. 

High-school  principals  and  teachers  of  the  social  sciences  will  be  interested  in 
reading  Professor  Judd's  paper  on  social  studies  in  the  high  school,  presenting  difiScul- 
ties  in  the  way  of  the  introduction  of  social  studies,  together  with  a  constructive 
program  for  the  introduction  of  such  studies. 

Every  year  sees  great  progress  in  the  application  of  scientific  methods  to  the 
problems  of  education.  Personal  opinion  is  rapidly  being  replaced  by  decisions  based 
on  the  scientific  measurements  of  facts.  In  an  article  on  "Intelligence  Testing  for 
the  Classification  and  Guidance  of  High  School  Pupils"  Professor  Buckingham  has 
pointed  out  the  need  and  importance  of  intelligence  tests.  School  superintendents 
and  principals  will  be  interested  in  the  list  of  available  group  tests  which  Professor 
Buckingham  has  listed. 

The  "Project  Method"  of  teaching  probably  has  been  more  successfuUy  used 
in  agriculture  than  in  any  other  subject.  In  fact,  there  are  many  who  have  come  to 
the  conclusion  that  the  "Project  Method"  is  one  that  has  little  value  except  in  agricul- 
ture. A  large  part  of  the  agricultural  program  was  devoted  to  presentations  and 
discussions  of  various  projects.  Perhaps  the  most  successful  of  the  high-school  agricul- 
tural projects  thus  far  reported  is  the  project  "An  Experiment  on  Profit  from  City  Bred 
Pigs"  which  has  been  carried  on  by  R.  W.  Sutherland,  a  student  in  the  Galesburg 
High  School.  Agricultural  teachers  will  not  only  be  interested  in  these  various  "proj- 
ects," but  they  will  find  a  valuable  contribution  on  "The  Point  of  View  of  the  Teacher 
of  Vocational  Agriculture"  by  Professor  G.  A.  Works  of  Cornell  University. 

In  the  Biology  Section  there  seemed  to  be  general  agreement  that  the  time  has 
come  for  a  rather  complete  reorganization  of  the  course  of  study  in  biology.  Much 
of  what  has  been  taught  in  biology  in  the  past  is  not  essential  for  high-school  students. 
The  present  pressure  for  time  requires  the  elimination  of  all  non-essentials.  Mr.  H.  D. 
Waggoner,  Macomb,  stated  so  ne  of  the  difficulties  in  the  way  of  reorganization  and 
gave  a  clear  presentation  of  the  essential  objectives  in  biology.  Every  teacher  of 
zoology  should  read  Miss  Mabel  E.  Smallwood's  contribution  on  "Fundamentals  in 
a  High  School  Course  in  Zoology."  The  points  brought  out  in  this  paper  are  pre- 
requisite to  effective  teaching  in  this  field.  Mr.  J.  L.  Pricer  presented  a  paper  on 
"The  Outlook  for  Biological  Science  in  the  Reconstruction  of  Secondary  Education." 
There  is  included  in  the  Proceedings  Professor  J.  M.  Coulter's  talk  on  "Botany  as  a 
National  Asset." 
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It  seems  unnecessary  and  out  of  place  in  a  bripf  review  to  discuss  in  detail  all  the 
many  valuable  contributions  to  the  various  sections.  It  would  be  a  mistake,  however, 
to  omit  mentioning  Arthur  Bovee's  "Teaching  Vocabulary  by  the  Direct  Method," 
one  of  the  most  valuable  contributions  to  the  Modern  Language  Section  for  several 
years.  The  technic  of  teaching  modern  language  has  been  radically  changed  since  the 
general  introduction  of  French  during  the  World  War.  We  hear  much  discussion  of 
the  "Direct  Method."  Mr.  Bovee,  University  of  Chicago  High  School,  is  a  master 
in  the  use  of  this  particular  type  of  technic.  Every  teacher  of  French  will  find  valuable 
aid  in  Mr.  Bovee's  article. 

In  general,  the  1919  Proceedings  of  the  High  School  Conference  represents  the 
most  modern  educational  theories  and  the  practice  of  teachers  and  administrators  who 
are  making  a  success  in  the  educational  field.  Every  teacher,  principal,  and  superin- 
tendent will  find  material  in  the  1919  Conference  Proceedings  relating  to  his  own 
special  interest. 

A.  W.  Clevenger 
University  of  Illinois 

BoNSER,  Frederick  Gordon.  The  elementary  school  curriculum.  New  York.   Mac- 
millan  Company,  1920.    460  pp. 

A  third  book  on  the  elementary  school  curriculum  has  appeared  and  reaffirms 
a  "genuine  need  for  a  thoroughgoing,  constructive  revision  of  the  curriculum."  Other 
books  or  studies  with  a  similar  purpose  are  already  in  the  making.  All  these  studies 
are  most  welcome. 

Professor  Bonser  acknowledges  that  a  curriculum  organized  wholly  upon  a  basis 
of  activities  of  life  is  desirable,  but  recognizes  that  the  present  curriculum  is  thoroughly 
established  upon  a  subject  basis.  An  abrupt  change  would  be  impracticable,  he 
maintains,  and,  therefore,  he  offers  in  his  book  "a  mode  of  natural  transition." 

The  first  eight  chapters  are  devoted  to  principles  in  curriculum  making.  In  the 
next  nine  chapters  the  application  of  these  principles  is  described.  The  concluding 
chapter  tells  how  this  book  may  be  used  in  improving  curricula.  The  first  eight  chapters 
center  about  the  project  method,  especially  discussed  in  chapter  vi.  "A  project  is 
a  purposeful  act.  .  .  .  The  project  method  holds  that  the  desirable  and  interesting 
hfe  activities  in  which  children  spontaneously  engage,  or  the  activities  in  which  they 
may  be  led  to  engage  whole-heartedly  and  enthusiastically,  should  be  the  basis  of  all 
educational  endeavor."  The  curriculum  must  thus  be  very  closely  related  to  life 
purposes  and  life  activities. 

In  chapters  ix  to  xin  and  chapter  xvi,  Professor  Bonser  presents  "projects"  that 
may  be  used  in  each  of  the  first  six  grades  in  teaching  the  school  subjects,  practical 
arts,  geography,  arithmetic,  history,  English,  and  physical  education  and  hygiene. 
Such  projects  are  not  outlined  for  fine  arts,  music,  and  citizenship  in  the  other  three 
chapters  in  which  these  subjects  are  discussed. 

This  book  will  appeal  strongly  to  the  thousands  of  teachers  into  whose  hands  it 
will  go — and  go  it  will,  because  the  title  of  this  book  interests  thousands  of  grade 
teachers.     And  the  book  will  contribute — somewhat — to  progressive  education. 

To  compromise  between  a  curriculum  that  is  "ideally  desirable"  and  one  that 
needs  "thoroughgoing,  constructive  revision,"  is  not  the  constructive  contribution 
desired  of  our  educational  leaders.    Our  modern  science  of  education  is  weakened  by 


390 


JOURNAL  EDUCATIONAL  RESEARCH      Vol.  3,  No.  5 


such  procedure.  That  an  abrupt  change  from  a  curriculum  of  school  subjects  to  a 
curriculum  of  life  activities  is  neither  desirable  nor  feasible  need  not  forbid  an  educa- 
tional leader  proposing  a  definite  program  according  to  his  very  best  standards.  Adap- 
tation to  present  conditions  is  another  problem.  Professor  Bonser  grants  that  a 
curriculum  based  on  activities  of  life  is  desirable.  He  presents  a  "mode  of  transition," 
but  leaves  the  reader  in  ignorance  of  the  real  curriculum  to  which  such  transition 
leads.    This  compromise  leads  to  other  weaknesses. 

The  project  as  a  purposeful  life  activity,  in  which  children  engage  whole-heartedly 
and  enthusiastically,  is  debased,  by  this  compromise,  to  essentially  a  device  for  teaching 
the  schoolroom  subjects.  Just  here  Professor  Bonser  (and  many  other  recent  writers 
on  phases  of  the  "project  method")  pours  new  wine  into  old  bottles  with  evil  results. 
Current  life  activities  teem  with  interest  to  the  normal  child.  This  situation  the 
author  recognizes.  But  the  schoolroom  subjects  do  not  thus  appeal  to  the  child. 
What  can  be  done?  Eureka!  Use  the  former  as  a  means  of  teaching  the  latter.  And 
it  works!  Note  the  "arithmetic"  given  by  the  author  on  pages  246-247,  248,  249, 
for  grades  rv,  v,  and  vi  respectively.  Note  how  closely  this  "arithmetic"  corresponds 
with  that  prescribed  in  most  schools.  Now  examine  the  projects  which  the  author 
lists  in  connection  with  the  arithmetic.  How  strikingly  evident  that  the  "project," 
"a  purposeful  act,"  is  used  by  the  teacher  as  a  method — a  bait — by  which  to  ensnare 
the  interest  of  pupils  and  fasten  it,  for  the  time,  upon  that  in  which  he  has  no  normal 
interest.  Professor  Bonser's  presentation  of  the  project  and  its  use  in  teaching  the 
traditional  school  subjects  stamps  this  book  as  a  manual  of  method  rather  than  a 
study  of  the  curriculum. 

The  author's  desire  to  compromise  through  a  "mode  of  natural  transition"  has 
led  him  to  some  apparent  contradictions.  In  chapter  vi  emphasis  is  placed  upon  a 
curriculum  of  purposeful  activities — projects.  The  sequence  of  projects,  he  says, 
is  determined  by  the  interests  and  capacities  of  the  pupils,  and  cannot  be  in  accordance 
with  a  logical  organization  of  school  subjects.  "There  are  no  life  activities  in  subject 
matter  as  such"  (105).  So  far,  so  good!  But  in  later  chapters  the  traditional  order 
prevails,  as  in  the  chapter  on  arithmetic:  ".  .  .  .  the  sequence  found  in  the  usual 
text  books  in  arithmetic  will  be  approximated"  (241). 

Had  the  book  been  entitled  "The  Project  Method  AppUed  to  the  Traditional 
Curriculum,"  and  the  best  part  of  chapter  vi  omitted,  teachers  would  have  had  a 
very  substantial  and  popular  manual  on  one  method  of  teaching.  In  that  case  the  book 
would  have  been  free  from  the  adverse  criticisms  I  feel  bound  to  offer.  The  book  will  be 
generally  well  received.  It  will  call  forth  more  study  on  the  "project  method,"  on 
projects,  on  methods,  and  perhaps  on  the  curriculum. 
University  of  Missouri  J.  L.  Meriam 


Turner,  E.  A.    The  essentials  of  good  leaching.  New  York:  D.  C.  Heath  &  Co.  1920. 

263  pp. 

Three  distinctly  different  aims  have  determined  the  organization  and  content 
of  recent  discussions  of  methods  of  teaching.  Some  writers  are  interested  primarily 
in  telling  teachers  how  to  conduct  recitations  effectively.  Consequently  their  dis- 
cussions are  full  of  helps,  outlines,  devices,  and  concrete  suggestions  concerning  the 
best  ways  of  securing  desired  results.  A  second  group  of  writers  are  interested  in 
reviewing  the  results  of  experimentation,  and  in  interpreting  these  results  in  terms  of 
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economical  classroom  procedure.  A  third  group  of  writers  believe  that  improvement 
in  the  art  of  teaching  can  be  secured  most  effectively  only  when  teachers  have  a 
thorough  grasp  of  the  basic  principles  of  good  teaching.  They  therefore  center  atten- 
tion on  those  principles  which  underlie  and  explain  the  best  practice.  Each  type  of 
discussion  makes  a  distinct  contribution.  The  most  helpful  type  for  classroom  teachers 
is  one  which  utiUzes  fundamental  principles,  the  results  of  experimentation,  and 
concrete  devices  in  the  discussion  of  specific  problems. 

Professor  Turner  in  The  Essentials  of  Good  Teaching  aims  "to  lay  bare  the  essen- 
tials of  good  teaching  in  a  simple,  concrete,  and  consistent  manner  in  order  to  conserve 
the  time  and  energy  of  teachers  who  are  anxious  for  inteUigent  guidance  in  their 
teaching."  At  the  very  outset,  he  presents  a  comprehensive  view  of  the  prerequisites 
to  a  successful  teaching  act.  These  include  a  clear  recognition  of  the  social  aim  of 
education,  the  function  and  structure  of  subject  matter,  a  knowledge  of  the  reactive 
attitude  of  the  child,  a  knowledge  of  appropriate  stimuli,  skillful  control  of  stimuli, 
and  enthusiasm  for  teaching.  The  essential  points  which  are  discussed  agree  very 
closely  with  the  most  progressive  tendencies  of  the  times.  Each  point  is  well  supported 
by  social,  psychological,  and  philosophical  considerations.  More  frequent  reference 
to  recent  experimental  results  would  have  added  materially  to  the  objectivity  of  these 
discussions. 

Along  with  the  discussion  of  fundamental  principles,  considerable  attention  is 
given  to  concrete  illustrations  and  applications.  The  discussions  of  the  value  and 
methods  of  comparison,  the  application  of  principles  to  reading,  primary  arithmetic, 
writing,  and  spelling,  and  the  use  of  tests  in  improving  instruction  are  especially  pointed 
and  effective.  Inasmuch  as  the  author  has  a  wealth  of  concrete  illustrations  at  his 
command,  it  is  somewhat  unfortunate  that  additional  space  was  not  available  for  a 
larger  number. 

The  book  centers  attention  on  fundamental  principles  and  stimulates  independent 
thinking  concerning  the  most  significant  classroom  problems,  and  is  probably  best 
adapted  to  the  needs  of  experienced  teachers.  It  supplies  a  safe  and  sane  philosophy 
of  teaching,  and  can  be  used  as  a  safe  guide  in  reorganizing  many  phases  of  current 
instruction.  On  account  of  its  simple  style  and  its  wealth  of  detail^  the  book  is  easily 
read  and  understood. 

W.  S.  Gkay 
University  of  Chicago 

McGregor,  A.  Laura.    Supervised  study  in  English.    New  York:    Macmillan  Co., 
1921.  220  pp. 

The  substance  of  this  new  book  for  supervisors  and  for  tes^chers  of  English  con- 
sists of  many  lessons,  intrinsically  interesting  and  highly  suggestive,  reported  minutely 
from  the  practices  of  the  Enghsh  department  of  the  Washington  Junior  High  School, 
Rochester,  New  York.  The  writer,  herself  the  supervisor  of  English  and  director 
of  vocational  guidance  in  the  school  named,  reduces  mere  theory  and  pedagogical 
discussion  to  a  minimum;  she  rests  her  case  primarily  upon  an  imposing  array  of 
concrete  material,  which  she  treats  as  illustrative  of  several  innovating  principles  in 
the  teaching  of  the  mother  tongue.  Three  principles  apparently  are  uppermost  in  the 
author's  conception:  (1)  abolishing  the  formal  recitation  and  for  it  substituting 
laboratory  procedure  full  of  purposeful  activity  on  the  part  of  the  pupils;  (2)  managing 
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the  assignment  of  laboratory  tasks  so  that  each  pupil,  be  he  of  low,  of  average,  or  of 
high  ability,  will  be  constantly  working  at  his  own  maximum;  (3)  utilizing  to  the  full, 
through  socialized  recitations  and  project  teaching,  the  cooperative  group  impulses  of 
adolescent  children  in  grades  vn,  vni,  ix.  In  short,  Miss  McGregor  has  utilized 
the  title  Supervised  Study  in  English  in  a  somewhat  larger  sense  than  the  one  in  which 
it  is  usually  employed. 

The  first  two  chapters  develop  the  meaning  of  supervised  study  as  it  has  been  set 
forth  by  McMurray,  Erhart,  Hall-Quest,  and  others,  and  apply  it  with  special  reference 
to  the  problems  of  English.  Then  in  order  follow  chapters  on  oral  English,  on  litera- 
ture, on  composition,  on  grammar,  on  special  kinds  of  skill  in  English,  and  on  the  use 
of  projects  in  English.  Each  chapter  contains  from  five  to  ten  sample  lessons;  for 
instance,  chapter  m  on  oral  English  contains  among  others  a  seventh-grade  lesson 
in  correct  speech,  an  eighth-grade  lesson  in  vocabulary  building,  and  a  ninth-grade 
lesson  in  library  reference  reading.  Each  lesson  is  divided  into  parts,  review,  assign- 
ment, and  silent  study  predominating,  with  verification  and  socialized  lesson  appear- 
ing in  some  cases.  To  each  of  these  parts  is  allotted  a  portion  of  the  sixty-minute  period 
appropriate  to  the  subject  matter  concerned;  the  review  is  short,  usually  from  ten 
to  twelve  minutes;  the  assignment  varies  greatly  in  length,  from  thirteen  to  thirty 
minutes,  and  averaging  40  percent  of  the  class  time;  the  silent  study  averages  about 
twenty  minutes. 

One  of  the  significant  features  of  the  lessons  for  students  of  education  is  the  large 
variety  of  situations  in  which  assignments  are  worked  out  on  the  basis  of  minimum, 
average,  and  maximum  difl&culty,  together  with  a  report  in  nearly  every  case,  of  the 
nimiber  of  children  who  in  the  respective  lessons  were  able  to  fulfill  the  different  assign- 
ments. Minimum  and  maximum  assignments  are  met  usually  by  a  minor  part  of  the 
class;  the  average  assignment  by  the  greater  number  of  the  pupils.  This  distribution 
is  not  uniform,  however.  The  pupil  grouping  in  one  vniA  lesson  in  vocabulary  building 
was  minimum  4,  average  13,  maximum  18;  evidently  an  easy  lesson. 

One  who  believes  that  the  day  of  the  formal  recitation  is  past  will  find  abundant 
comfort  in  the  apparent  reasonableness  of  Miss  McGregor's  contributions.  He  will 
find  individualization  of  instruction,  pupil  initiative,  project  teaching,  sociaUzed 
recitation — in  short,  the  laboratory  emphasis  and  procedure — exemplified  and  illus- 
trated in  a  hundred  different  ways.  When  these  principles  are  applied  universally, 
as  apparently  they  are  applied  in  Miss  McGregor's  Enghsh  department,  a  new  day 
will  have  come  in  the  teaching  of  the  mother  tongue. 

R.  L.  Lyman 
University  of  Chicago 


N^tuB  3tem0  unh  (UnmrnnnimtioxiB 

This  department  will  contain  news  items  regarding  research  workers 
and  their  activities.  It  will  also  serve  as  a  clearing  house  for  more  formal 
communications  on  similar  topics,  preferably  of  not  more  than  five  hundred 
words.  These  communications  will  be  prmted  over  the  signatures  of  the 
authors.  Address  all  correspondence  concerning  this  department  to  Walter 
S.  Monroe,  University  of  Illinois,  Urbana,  Illinois. 


t  ^  During  the  week  of  March  22  and  March  26  a  number  of 
Schoolmen's  Week  educational  groups  met  at  the  University  of  Mmnesota.  The 
at  the  University  ,  most  important  events  of  this  meeting  were  the  Eighth  Annual 
of  Minnesota  Short  Course  for  Superintendents  and  Principals,  and  the  Fifth 

Annual  Conference  of  Minnesota  High  School  Teachers.  In 
addition  to  local  talent  Professor  E.  L.  Thorndike,  Dean  J.  W.  Withers,  and  Professor 
Charles  H.  Judd  contributed  to  the  program. 

The  Bureau  of  Tests  and  Measurements  of  the  University  of 
Michigan  Con-  Michigan  held  a  conference  at  Ann  Arbor  on  the  evening  of  March  29. 
ference  on  The  program  was  devoted  to  the  consideration  of  one  topic:  "The 

Educational  Classification  of  Pupils  on  the  Basis  of  Intelligence  Tests."    School 

Measurements    men  from  eleven  Michigan  cities  were  scheduled  to  make  formal 
formal  reports  on  this  topic. 

A  bulletin  of  the  Research  Department  of  the  Ohio  State  Teachers'  Association 
for  March,  1921,  gives  a  list  of  the  studies  recently  completed,  or 
Educational  now  in  progress  by  46  members  of  the  department.     Of  these 

Research  in  Ohio  studies,  45  are  reported  as  completed  and  88  as  in  progress.  If 
the  large  number  of  studies  reported  as  being  in  progress  are  carried 
to  completion  the  reports  of  this  association  will  make  a  large  contribution  to  our 
accumulation  of  knowledge  in  this  field.  The  report  is  sent  by  Professor  R.  L.  Morton 
of  Ohio  University,  Athens,  president  of  the  department,  and  Superintendent  F.  J. 
Prout,  Chillicothe  public  schools,  secretary  of  the  department. 

The  following  program  was  announced  for  the  joint  meeting,  on  March  11,  of 
the  sections  for  educational  measurements  and  for  grammar  grades  of 
Educational     the  Southern  Wisconsin  Teachers'  Association. 

Research  In  What  About  Grammar?    Superintendent  E.  G.  Doudna,  Wisconsin 

Wisconsin        Rapids — 30  minutes.    Discussion — Professor  F.  L,  Clapp,  University 

of  Wisconsin — 15  minutes. 

Utilising  Intelligence  and  Achievement  Tests  for  a  More  Elective  Technique  in 

Arithmetic— Yi.  A.  Cook,  Principal  of  Junior  High  School,    Merrill— 25 

minutes. 

Individualization  of  Instruction  in  Algebra  and  Elementary  Mathematics — Mary 

A.  Potter,  Racine  High  School — 15  minutes. 
Improvemeni  in  Comprehension  in  Silent  Reading — Prudence  Cutright,  Supervisor 
of  Primary  Grades,  La  Crosse — 25  minutes. 
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Variability  of  Improvement  in  Spelling — Rose  Gagen,  Janesville — 15  minutes. 
Dean  M.  E.  Haggerty  of  the  University  of  Minnesota  addressed  the  meeting  of 
the  association  on  "Service  of  General  Intelligence  Tests." 

We  continue  to  receive  from  China  evidence  of  unusual  interest  in  educational 

and  intelligence  tests.    This  interest  is  shown  not  only  by  the  resident 

Educational      American  teachers,  but  also  by  the  native  teachers.    We  received  a 

Research  in     letter  a  few  days  ago  from  Professor  H.  C.  Chen  of  the  Nanking  Teachers 

China  College.    Professor  Chen  says  in  part: 

"Dr.  S.  C.  Liao  and  myself  have  been  working  on  educational  and 
mental  tests  for  the  last  year  and  a  half.  A  book  on  mental  tests  will  appear  in  Chinese 
in  two  months'  time.  It  embodies  thirty-five  different  tests.  Eleven  of  them  are  our 
own  work,  and  the  rest  are  translations  with  modifications.  Practically  all  of  the 
tests  have  been  tried  in  the  Chinese  schools,  missionary  or  government.  This  work 
is  of  course  tentative,  but  we  hope  to  standardize  these  tests  as  time  goes  on. 

"In  addition,  I  have  devised  a  number  of  Chinese  language  tests  such  as  language 
completion  tests,  dictation  tests,  opposites  tests,  etc.  As  a  preliminary  step  we  used 
five  tests  for  the  last  entrance  examination  of  our  college.  The  correlation  between 
the  tests  and  the  average  grades  of  the  regular  examinations  was  0 .  39.  It  might  have 
been  higher,  had  we  excluded  the  marks  of  the  students  in  mathematics  and  Chinese 
language  which,  as  I  was  told  by  the  Dean  of  the  College,  were  unscientifically  graded 
and  too  difficult  for  the  candidates." 

Professor  Chen  enclosed  with  his  letter  a  number  of  tests  such  as  he  is  using.  In 
addition  to  analogies,  opposites,  language  completion,  etc.  there  was  a  spelling  test. 
We  had  supposed  that  the  Chinese  did  not  spell,  yet  here  there  are  apparently — "ap- 
parently" is  used  with  something  more  than  common  significance — twenty  timed 
sentences.    We  are  at  least  sure  that  there  are  twenty  items  of  some  sort. 

The  World  Book  Company  has  recently  issued  a  brief  bibliography  of  educational 

tests.    Two  hundred  seventy-eight  titles  are  listed.    It  is  significant 

A  Bibliography  of    that  a  commercial  firm  has  considered  it  worth  while  to  compile 

Educational  Tests  such  a  bibliography.     The  World  Book  Company  has  rendered 

a  distinct  service  by  compiling  and  publishing  this  bibliography. 

The  influence  of  Dr.  Ayres'  method  of  investigation  by  means  of  an  index  number 
is  seen  in  a  monograph  by  Thomas  E.  Benner,  statistician  for  the  Alabama  State 

Department  of  Education.  The  monograph  is  entitled,  "A  Compara- 
An  Index  tive  Study  of  the  Elementary  Schools,  White  and  Colored,  of  the 

Number  in  a  Sixty-seven  Counties  of  Alabama."  Ten  items  are  used  in  appraising 
State  Survey      the  schools  of  each  county,  and  when  the  entries  under  the  items  are 

averaged,  the  general  index  number  ranges  for  the  sixty-seven  counties 
from  38.0  to  75.2.  The  text  accompanying  the  tables  and  charts  purposely  avoids 
technical  terms  and  leaves  the  reader  to  draw  his  own  conclusions.  Mr.  Benner 
says  of  the  report:  "So  far  as  I  know,  this  is  the  first  time  that  both  the  white  and 
colored  schools  have  been  measured — if  the  material  of  this  study  be  accepted  as  a 
measurement — in  terms  of  the  same  units  for  an  entire  state."  We  know  of  nothing 
to  the  contrary. 


May,  1921         NEWS  ITEMS  AND  COMMUNICATIONS  395 


Houghton  Mifflin  Company  announces  a  series  of  five  tests  under  this 
title.    They  were  devised  by  Harriet  E.  Peet,  co-author  of  "Everyday  Arithmetic," 

and  Walter  F.  Dearborn,  Professor  of  Education,  Harvard  Univw- 
Progress  Tests  sity.  There  is  one  test  on  each  of  the  four  fundamental  operations. 
in  Arithmetic       The  fifth  is  a  problem  test.    In  each  test  there  are  several  different 

types  of  exercises  and  they  appear  to  be  arranged  in  order  of  increas- 
ing difficulty.  No  measure  of  the  rate  of  work  is  obtained.  The  authors  state  that 
the  tests  include  the  "leading  difficulties  that  the  pupils  need  to  master."  The  tests 
are  intended  to  supplement  rather  than  to  replace  the  tests  of  the  type  of  Courtis 
Research  Tests  in  Arithmetic,  Series  B,  which  yield  measures  of  rate. 

When  the  Picture  Supplement  Reading  Scale  by  May  Ayres  Burgess  appeared,  it 
was  obvious  to  those  who  had  had  wide  experience  with  educational 
Directions  for      tests  that  detailed  directions  for  scoring  would  be  necessary  if  a  high 
Scoring  the  degree  of  objectivity  was  to  be  secured.    No  such  directions  were 

Burgess  Read-    furnished   by    the   author.    Recently  the  Bureau  of   Tests  and 
ing  Scale  Measurements  of  the  University  of  Michigan,  which  is  supervis- 

ing the  use  of  this  scale  in  Michigan,  has  issued  a  set  of  detailed 
directions  for  scoring  it.  These  will  doubtless  be  welcomed  by  all  of  those  who  have 
attempted  to  use  the  scale. 

The  Carnegie  Corporation  of  New  York  has  recently  published  the  result  of  the 

Americanization  studies  to  determine  the  provision  for  teaching 

Provision  for        English  to  non-English-speaking  foreigners  in  our  public  schools. 

Schooling  the       The  following  statements  are  quoted  because  they  have  a  general 

Immigrant  interest: 

"if  an  immigrant  from  a  non-English-speaking  country  chooses 
to  leam  English  in  the  public  schools  here,  he  must  select  with  care  the  place  of  his 
residence  in  this  country,  for  only  one  city  in  five  has  any  public-schooling  provision. 
'It  is  evident  from  the  statistics  gathered  that  his  chances  of  finding  a  school 
in  any  urban  community  increased  40  percent  from  1914-1915  to  1918-1919;  but  he 
also  has  an  eight  times  better  chance  if  he  goes  to  a  place  having  more  than  1,000 
foreign-born  residents  than  if  he  goes  to  one  having  less  than  that  number. 

If  he  will  also  pick  out  a  place  having  a  population  of  over  25,000,  he  will  have 
about  seven  chances  in  ten  of  finding  public-schooling  provision;  on  the  other  hand, 
he  has  one  chance  in  ten  in  a  town  of  less  than  10,000  population." 

At  the  Alumni  Dinner  held  in  connection  with  the  meeting  of  the  Department 
of  Superintendence  at  Atlantic  City,  Dean  James  E,  Russell  announced  the  establish- 
ment by  the  Trustees  of  Teachers  College  of  an  Institute  of  Educa- 
Institute  of  tional  Research.  For  the  first  time  in  the  history  of  American  educa- 
Educational  tion,  the  scientific  investigation  of  education  is  to  be  undertaken  on  a 
Research  basis  comparable  to  that  enjoyed  by  the  research  foundations  devoted 

to  science,  engineering,  and  medicine. 

The  Institute  is  to  be  organized  with  Professor  E.  L.  Thorndike  as  the  Director 
of  the  Division  of  Educational  Psychology,  Professor  Otis  W,  Caldwell  as  the  Director 
of  the  Division  of  School  Experimentation,  and  Professor  George  D.  Strayer  as 
Director  of  the  Division  of  Field  Studies. 
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The  work  of  the  Institute  is  to  be  supported  by  funds  provided  by  the  Trustees 
of  Teachers  College  and  by  gifts  supplied  either  by  way  of  general  endowment  or  for 
the  purpose  of  conducting  particular  investigations.  Funds  have  already  been  provided 
by  the  General  Education  Board  for  the  work  of  the  Lincoln  School  which  will  be  a 
very  important  part  of  the  Division  of  School  Experimentation.  This  part  of  the 
enterprise  is  well  under  way  under  Dr.  Caldwell's  direction  in  the  Lincoln  School  of 
Teachers  College. 

The  Commonwealth  Fund  has  made  a  grant  in  support  of  an  inquiry  concerning 
methods  of  learning.  This  investigation  will  be  undertaken  during  the  next  year  by 
Professor  Thorndike.  From  the  same  source  funds  have  been  provided  for  a  study 
of  financing  of  American  city  school  systems.  This  inquiry  is  undertaken  in  co- 
operation with  the  Committee  for  Chamber  of  Commerce  Cooperation  with  the 
Public  Schools  under  Professor  Strayer's  direction. 

Relationship  Between  General  Intelligence  and  Success  in  Certain 
High-School  Subjects 

During  the  school  year  1919-1920,  the  writer  gave  the  Alpha  Army  Test  to  the 
high-school  students  of  the  Omaha  high  schools.  Significant  intelligence  differences 
were  found  among  the  three  high  schools.  This  was  particularly  true  of  Central  High 
School  and  High  School  of  Commerce  where  a  difference  of  from  20  to  30  points  between 
corresponding  classes  was  found.  These  differences,  as  well  as  differences  in  social 
status  and  curricula  of  the  two  high  schools,  were  pointed  out  in  an  earlier  article  in 
this  Journal.*  Central  High,  it  was  found,  received  most  of  the  students  from  the 
well-to-do  and  professional  classes  for  classical  and  college  preparatory  courses; 
while  Commerce  High  received  most  of  the  students  from  the  laboring  and  less  well- 
to-do  classes  for  vocational  training.  The  striking  differences  in  the  curricula  of  the 
two  schools  may  be  seen  in  the  subjects  listed  in  Table  I. 

With  the  differences  mentioned  above  in  mind,  the  writer  considered  two  ques- 
tions: (1)  Do  certain  high-school  subjects  require  greater  general  intelligence  of 
the  type  measured  by  the  Alpha  Army  Test  than  others?  (2)  Do  the  students  less 
endowed  in  that  type  of  intelligence  do  effective  work  in  vocational  subjects?  To 
answer  these  questions  the  marks  were  given  at  the  end  of  the  first  semester,  1920, 
obtained  from  both  schools  for  the  students  who  had  been  given  the  Alpha  Test. 
The  median  intelligence  score  for  the  students  who  failed  and  for  those  who  received 
passing  marks  was  then  found.  This  was  done  for  a  number  of  school  subjects,  and 
for  the  boys  and  girls  of  each  class  separately.    The  results  appear  in  Table  I. 

From  this  table,  it  appears  that  greater  intelligence  is  required  for  success  in  the 
subjects  taught  in  Central  High  than  for  success  in  the  subjects  taught  in  Commerce 
High,  It  also  appears  that  differences  in  the  degree  of  intelligence  required  for  success 
exist  for  the  subjects  taught  within  each  school.  In  Central,  Latin  holds  first  place 
throughout  the  four  classes.  In  the  same  school,  manual  training,  mechanical  drawing, 
typewriting,  and  bookkeeping  are  at  the  bottom  in  the  classes  in  which  they  are  given. 
The  same  consistency  does  not  appear  for  the  vocational  subjects  taught  in  Commerce 
High,  although  there  is  a  tendency  for  typewriting  and  bookkeeping  for  the  boys 
and  sewing  and  cooking  for  the  girls  to  occur  at  the  bottom  of  the  list.    From  this 

'  Madsen,  I.  N.  "Group  Intelligence  Tests  as  a  Means  of  Prognosis  in  High  School,"  Journal  of 
Educational  Resevch,  i'Ai-Sl,  January,  1921. 
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table  it  seems  fair  to  conclude  that  general  intelligence  as  measured  by  the  Alpha 
Test  is  an  important  factor  in  a  high-school  pupil's  success  or  failure.  No  doubt  the 
results  in  these  tables  would  have  been  more  striking  if  other  factors  contributing 
to  a  student's  success  (such  as  emotional  traits,  school  attendance,  home  conditions, 
etc.)  were  constant  for  all  pupils. 

TABLE  I.    COMPARISON  OF  MEDIAN  INTELLIGENCE  SCORES  IN  ALPHA 
ARMY  TEST  OF  CENTRAL  AND  COMMERCE  HIGH- 
SCHOOL  STUDENTS  FOR  CERTAIN  SUBJECTS 
SHOWING  MEDIAN  FOR  PASSING  AND 
FAILING  STUDENTS 


Boys 

Girls 

Median 

Median 

Median 

Median 

Scores  of 

Scores  of 

Scores  of 

Scores  of 

Failed 

Passed 

Failed 

Passed 

Students 

Students 

Students 

Students 

Freshman  (Central) 

Latin  I  and  II 

109.2 

124.2 

107.1 

122.5 

Ancient  History  I  and  II 

97.3 

120.8 

91.0 

117.1 

English  I  and  II 

97.0 

118.8 

86.7 

108.7 

Algebra  I  and  II 

101.8 

113.2 

91.0 

113.9 

Manual  Training 
Mechanical  Drawing 
Household  Arts 

102.7 

100  0 

101  0 

87.5 

98.2 

Freshman  (Commerce) 
T)^ewriting 

. 

70.0 

100.0 

80.0 

88.1 

Mechanical  Drawing 
Woodworking 
Telegraphy 
Rapid  Calculation 
Sewing 
Cooking 
Sophomore  (Central) 

76  0 

93.0 

64  0 

85.3 

70  0 

74.0 

60.7 

86.0 

70.0 

86.7 

77.5 

75 '.2 

Latin  III  and  IV 

140.0 

144.2 

128.3 

133.2 

Geometry  I  and  II 

109.2 

134.4 

106.4 

127.0 

Biology  I 

112.5 

133.7 

101.7 

122.6 

EngUsh  III  and  IV 

114.0 

131.2 

96.2 

125.0 

Mechanical  Drawing 
Household  Arts 

127.5 

108.7 

Sophomore  (Commerce) 

Algebra,  Science  and  Math. 
T)^ewriting 

70  0 

107  0 

80.0 

100.0 

90.0 

91.8 

Bookkeeping 

100.0 

100.0 

82.5 

91.8 

Cooking 
Sewing 

80.0 
80.0 

94.0 

89.0 
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TABLE  1— Continued 


Boys 

Girls 

Median 
Scores  of 

Failed 
Students 

Median 

Scores  of 

Passed 

Students 

Median 

Scores  of 

Failed 

Students 

Median 
Scores  of 

Passed 
Students 

Junior  (Central) 
Latin  III  and  IV 

142.5 

146.5 

Latin  II,  III,  IV,  V 

130.0 
106.6 
110.0 
100.0 
125.0 

139  7 

English  V  and  VI 

Amer.,  Anc,  and  Eng.  Hist. 

Algebra  III 

129.0 
126.6 

140.5 
139.2 
138.0 
133.6 
133.6 

134.1 
140.0 
133  0 

French  I  and  II 
Physics 

131.2 

135.8 

Household  Arts 



115  0 

Junior  (Commerce) 
Mechanical  Drawing 

102.5 
90.0 

106.3 

106.0 

95.0 

Typewriting 
Bookkeeping 

105.0 
60.0 
87.0 

112.5 

98.9 
113  7 

Stenography 
Senior  (Central) 
Latin  V,  VI,  VII,  VIII 

99  0 

158.9a 

154.3 

147.5 

146.6 

146.6 

141.4 

135.0 

150  0 

French  and  Latin 

130.0 

English  VII  and  VIII 

138  1 

Chemistry 

127.5 

90.0 

125.0 

138  0 

Algebra  III,  Geometry  and  Trig. 

American  History 
Bookkeeping 

111.6 

136.6 
132.5 

French  II,  III,  IV 

117.5 

147  1 

Household  Arts 

125  5 

*  Includes  Juniors  and  Seniors. 

In  answering  the  second  question  the  school  marks  given  in  the  two  high  schools 
were  studied.  The  same  marking  system  is  used  in  both  schools.  The  distributions 
of  marks  show  that  a  much  smaller  percent  of  pupils  failed  in  the  Commerce  High 
than  in  the  Central  High.  Thus,  either  the  standards  for  success  are  relatively  lower 
for  the  vocational  subjects  taught  in  Commerce  High  or  a  less  degree  of  intelligence  is 
required  for  success  in  them. 

The  results  obtained  in  this  investigation  would  suggest  the  desirability  of  testing 
prospective  high-school  students  as  to  their  capacities  before  choosing  the  subjects 
which  they  attempt.  There  must  inevitably  be  many  misfits  by  our  present  empirical 
method.  Intelligence  tests  have  not  yet  been  brought  to  the  point  of  infallibility,  but 
if  skillfully  used  they  can  be  of  great  service.  It  would,  of  course,  be  desirable  to  have 
a  test  which  would  measure  capacity  for  vocational  subjects  in  the  same  way  that  the 
Alpha  Test  measures  capacity  for  the  classical  subjects.  This  would  provide  a  positive 
means  rather  than  a  negative  means  of  selecting  pupils  for  vocational  training. 

I.  N.  Madsen 
State  Normal  School,  Lemston,  Idaho 
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A  Social  Survey  of  the  Needs  in  Current  Reading 

Dr.  Walter  R.  Smith  in  "An  Introduction  to  Educational  Sociology,"  names  four 
specific  means  of  socializing  the  curriculum  in  our  schools.  These  four  means  are, 
the  elimination  of  the  material  least  useful;  the  addition  of  wide  ranges  of  knowledge 
demanded  but  not  now  included  in  school  courses;  the  organization  of  this  new  material 
in  harmony  with  the  old  into  a  well-rounded  program;  and  the  socialization  of  the 
methods  of  teaching  the  reorganized  material.  Professor  Smith  further  says:  "For 
both  eliminations  and  additions  the  social  survey  is  necessary.  In  just  what  subjects, 
and  in  just  what  materials  in  these  subjects,  has  society  a  right  to  expect  that  the 
pupils  leaving  a  school  will  be  proficient?  This  can  be  determined  only  by  learning 
what  the  larger  society  which  the  children  are  about  to  enter  demands  of  its  mature 
citizens." 

The  problem  of  this  survey  was  to  discover  the  lines  of  study  (and  their  relative 
proportion)  which  are  necessary  for  reading  our  weekly  magazines  intelligently. 

The  Independent  was  taken  as  a  typical  American  weekly  and  a  survey  of  this 
magazine  for  one  year  was  made.  The  method  of  investigation  was  to  record  data 
concerning  the  amount  of  attention  paid  by  The  Independent  to  the  various  topics 
it  discussed.  Fifty- two  copies  of  the  magazine  were  examined  and  the  number  of 
columns  given  to  the  various  topics  tabulated.  The  results  are  shown  in  Table  I. 
The  classifications  were  purely  arbitrary.  It  was  impossible  to  avoid  a  certain  amount 
of  overlapping  of  the  various  lines  of  study,  since  there  is  no  sharp  line  of  demarcation 
within  facts  which  may  be  classified  equally  well  as  belonging  to  economics,  sociology, 
history,  and  civics.  The  study  was  made  before  the  war  and  the  conclusions  are 
such  as  would  apply  to  normal  times. 

In  the  fifty-two  issues  we  find  that  583  columns  were  devoted  to  modern  political 
history.  Under  this  heading  were  discussed  political  situations  in  foreign  countries, 
wars,  treaties,  revolutions,  peace  negotiations,  and  diplomatic  relations.  Since  the 
war  this  kind  of  reading  will  continue  to  be  far  bulkier  than  ever  before. 

Next  in  importance  is  the  study  of  economics,  covering  462  columns.  Important 
topics  discussed  are:  business,  finance,  currency,  stock  exchange,  cost  of  living,  tariff, 
income,  corporation  matters,  inheritance  tax,  capital  and  labor,  interstate  commerce. 

American  civics  and  politics  occupy  410  columns.  The  leading  topics  discussed 
are:  state  and  national  legislative  measures,  political  parties,  elections  and  appoint- 
ments, women's  suffrage,  administrative  measures,  government  ownership,  municipal 
government. 

Next  comes  sociology  with  325  columns.  The  main  topics  are:  great  interests 
which  make  up  American  life,  social  organization,  social  service,  development  of 
community  life,  the  care  of  defectives,  immigration,  the  race  question,  women's  clubs. 

The  space  occupied  by  each  of  the  other  topics  is  given  in  Table  I,  and  their 
scope  is  indicated  in  a  general  way  by  the  captions.  The  total  number  of  columns  is 
3,910. 

These  various  topics  readily  group  themselves  under  five  main  heads:  (1)  cultural, 
with  1,337  columns,  including  fine  arts,  biography,  education,  fiction,  religion,  ethics, 
humor,  and  poetry;  (2)  political,  with  993  columns,  including  modern  political  history 
and  American  civics  and  politics;  (3)  economic,  with  827  columns,  including  applied 
economics,  commercial  geography,  and  insurance;  (4)  social,  with  433  columns,  in- 
cluding public  health  and  sociology;  (5)  scientific,  with  320  columns,  including  physical 
geography,  agriculture,  and  applied  science. 
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TABLE  I.    NUMBER  OF  COLUMNS  DEVOTED  TO  TOPICS  IN  52  COPIES 
OF  THE  "independent" 


Topics 


Modem  Political  History 

Economics 

Civics  and  Politics 

Sociology 

Fiction 

Education 

Biography  (Articles  about  People) 

Fine  Arts 

Commercial  Geography 

Insurance 

Religion 

Science 

Physical  Geography 

Public  Health 

Agriculture 

Ethics 

Poetry 

Humor 


Total . 


Columns 


583 

462 

410 

325 

292 

260 

204 

196 

190 

175 

167 

115 

111 

108 

94 

90 

77 

51 


3,910 


It  is  a  matter  of  practical  value  to  know  the  relative  amount  of  attention  paid 
by  the  American  weeklies  to  matters  of  cultural  interest  compared  with  the  amount 
of  attention  paid  to  topics  of  a  political  and  business  nature.  We  find  in  this  particular 
case  that  1,820  columns  were  devoted  to  politics  and  business  and  1,288  columns 
to  matters  of  a  cultural  nature.  Other  interesting  comparisons  can  be  made  as  to  the 
amount  of  attention  paid  to  public  health  and  business,  sociology  and  politics,  educa- 
tion and  religion. 

The  four  classifications,  modern  political  history,  economics,  civics,  and  sociology, 
show  the  history  teacher  his  duty  and  opportunity.  History  should  be  made  a 
thing  of  the  present  and  not  a  fossil  of  the  past.  The  textbook  will  serve  only  as  a 
reference  outline  and  current  literature  should  afford  a  large  part  of  the  reading  in 
these  subjects.  The  subject  matter  will  thereby  bear  more  directly  on  the  problems 
which  the  student  is  likely  to  meet. 

The  work  of  the  English  teacher  would  cover  the  fields  of  fiction,  articles  about 
people,  poetry,  and  humor,  and  touch  upon  other  topics.  Why  should  not  the  English 
teacher  also  find  much  of  her  material  for  these  subjects  in  current  literature?  The 
magazines  constitute  much  the  greater  part  of  the  average  individual's  reading  after 
leaving  school.  It  would  seem  to  be  the  work  of  the  English  teacher  to  show  what 
was  good  and  bad  in  this  material,  to  teach  the  student  how  to  use  it,  and  at  the  same 
time  make  him  alert  to  contemporary  life. 

The  work  of  the  science  teacher  should  be  to  give  the  student  the  necessary 
foundation  and  a  glimpse  of  the  various  fields  in  order  that  he  may  read  current 
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scientific  literature  intelligently  and  with  pleasure.  In  this  the  teacher  should  also 
guide  the  pupil  to  what  is  worth  while  and  call  attention  to  the  more  authoritative 
periodic£Js.  For  many  otherwise  intelligent  readers  scientific  topics  are  more  or  less  of 
a  mystery. 

A  survey  of  this  type  is  the  best  means  of  enabling  curriculum  makers  to  secure 
a  basis  for  the  selection  of  subject  matter  which  deals  with  live  social  issues  of  present 
or  near-future  value  to  the  pupil  and  those  that  promise  to  be  of  value  when  the  pupil 
becomes  an  adult.  One  good  standard  for  judging  any  curriculum  is  the  extent  to 
which  it  acquaints  the  pupil  with  leading  interests  in  present  social  life. 

In  conclusion  I  again  quote  from  Professor  Smith:  "The  socialized  curriculum 
must  include  the  knowledge  areas  that  provide  the  facts  and  principles  which  lay  the 
foundations  of  efficiency  in  all  realms  of  society,  but  those  areas  upon  which  greatest 
emphasis  should  be  placed  must  be  determined  by  public  demand  as  shown  by  the 
social  survey." 

W.  D.  Akmentrout 
Colorado  State  Teachers  College, 
Greeley,  Colorado 


lEburattonal  E^fi^arrlj 

(E.  J.  AsHBAUGH,  Secretary  and  Editor) 


ANOTHER  STEP  FORWARD 

All  members  of  the  National  Association  of  Directors  of  Educational  Research 
who  were  not  at  the  annual  meeting  at  Atlantic  City  and  all  readers  of  this  Journal 
who  thereby  show  themselves  to  be  interested  in  the  scientific  study  of  education  will 
be  interested  in  the  step  made  by  the  association  in  restating  its  basis  for  membership. 
The  association  was  originated  to  encourage  the  establishment  of  bureaus  of  educa- 
tional research  and  to  promote  that  type  of  research  which  has  for  its  purpose  the 
improvement  of  school  efficiency.  It  has  served  this  purpose  well  as  the  growth  of  its 
membership,  the  interest  in  its  public  programs,  and  the  inquiries  which  have  come 
to  its  secretary  abundantly  attest. 

But  this  year,  those  attending  the  annual  meeting  felt  that  the  time  was  ripe  for 
a  forward  step  and  the  following  article  was  substituted  for  the  old  article  on  member- 
ship. 

MEMBERSHIP 

Membership  in  this  association  shall  be  of  two  classes — Honorary  and  Active. 
Honorary:  The  honorary  membership  shall  consist  of  those  individuals  who  have 
distinguished  themselves  in  the  field  of  educational  research  whom  the  association 
may  honor  itself  by  election  to  this  type  of  membership. 
Active:  The  active  membership  shall  consist  of  those  persons  who  may  be  elected  by 
the  executive  committee,  or  by  the  association  after  the  consideration  of  their 
qualifications  by  the  executive  committee,  on  the  presentation  of  satisfactory 
evidence  in  the  form  of  published  or  unpublished  studies  which  show  ability 
to  arrange,  to  organize,  and  to  conduct  research  investigations  and  experimenta- 
tions. 

Thus  our  association  becomes  the  first  and  only  association  which  places  ability 
in  educational  research,  attested  by  the  submission  of  evidence  of  work  already  done, 
as  the  qualification  for  membership.  The  National  Society  for  the  Study  of  Education 
and  the  National  Society  of  College  Teachers  of  Education  are  both  notable  organiza- 
tions, having  among  their  members  many  of  the  best  workers  in  educational  research 
in  our  country,  but  they  have  not  required  that  applicants  for  membership  should  pre- 
sent evidence  of  ability  in  this  line. 

Those  who  sponsored  the  change  presented  the  following  argument  which  made 
instant  appeal  to  the  members  present.  The  movement  for  careful  scientific  educa- 
tional research  is  already  well  under  way  in  universities,  colleges,  normal  schools, 
state  departments,  and  city  school  systems.  The  present  need  is  not  so  much  to 
foster  the  establishment  of  new  bureaus,  though  that  remains  as  one  of  the  purposes 
of  the  association,  as  it  is  to  unify  the  research  activities  of  the  workers  all  over  the 
country  and  to  bring  together  for  mutual  help  and  encouragement  those  who  are 
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originating,  organizing  and  directing  educational  investigations  and  experimentations. 
In  other  words,  the  association  felt  that  its  own  needs  and  the  needs  of  those  who, 
while  not  in  organized  bureaus  of  research,  were  doing  work  of  real  value  were  identical. 

The  executive  committee  who  must  pass  upon  the  credentials  submitted,  faces 
the  new  situation  with  both  hope  and  fear.  It  hopes  that  the  appeal  for  membership 
which  the  association  thus  frankly  makes  will  be  met  with  a  hearty  response  from  the 
best  workers  who  have  hitherto  been  ineligible.  It  fears  that  some  applications  may 
come  from  those  who  have  done  one  piece  of  research  of  perhaps  fair  or  even  excellent 
quality  but  who  have  since  been  resting  contented  with  whatever  impetus  that  one 
piece  may  have  given  them.  It  hopes  that  the  present  membership  will  scan  carefully 
not  only  the  past  but  also  the  present  work  of  those  whom  they  may  recommend  for 
consideration.  It  is  ambitious  that  our  association  shall  have  the  largest  proportion 
of  live,  growing,  producing  educational  workers  of  any  association  anywhere. 

Hence,  to  the  present  membership  there  comes  a  definite  challenge.  Find  and 
recommend  to  the  executive  committee  those  who  not  only  have  produced  and  are 
producing  but  who  will  continue  to  produce.  And  prove  your  own  eligibilty  to  con- 
tinued membership.  Let  the  new  year  be  one  of  definite  growth  for  each  of  us.  Plan 
definitely  some  constructive  piece  of  work  which  can  be  finished  and  reported  within 
the  next  twelve  months.  Test  your  ability  for  original  thinking.  Submit  yourself  to 
stern  criticism.  Determine  that  you  will  meet  to  some  degree,  to  a  degree  worthy  of 
yourself,  the  demands  of  this  new  Step  Forward. 

Last  year  in  this  issue  of  the  Journal  the  complete  membership  of  our  association 
was  printed.  It  consisted  of  seventy-seven  names,  of  which  six  were  those  of  honorary 
members.  The  new  list,  complete  according  to  the  records  of  the  secretary  on  April  1, 
consists  of  one  hundred  one  names,  of  which  ten  are  honorary.  The  following  have  re- 
signed during  the  past  year,  due  in  all  cases  to  a  change  in  occupation:  W.  Randolph 
Burgess,  C.  A.  Carney,  F.  S.  Shapleigh. 

LIST  OF  MEMBERS  OF  THE  NATIONAL  ASSOCIATION  OF  DIRECTORS  OF 
EDUCATIONAL  RESEARCH 

Honorary  Members 

Ayres,  Dr.  L.  P.,  Vice-President,  Cleveland  Trust  Co.,  Cleveland,  Ohio. 
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Judd,  Dr.  Chas.  H.,  University  of  Chicago,  Chicago,  Illinois. 
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Russell,  Dr.  William  F.,  Dean,  School  of  Education,  State  University  of  Iowa,  Iowa 

City,  Iowa. 
Thorndike,  Dr.  E.  L.,  Teachers  College,  Columbia  University,  New  York  City, 

New  York. 
Wissler,  Dr.  E.  C,  National  Research  Council,  1701  Massachusetts  Ave.,  Washington, 

D.  C. 
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Regular  Members 

Alexander,  Dr.  Carter,  State  Department  of  Public  Instruction,  Madison,  Wisconsin. 

Anderson,  H.  W.,  Assistant  Director,  Educational  Research,  50  Broadway,  Detroit, 
Michigan. 

Ashbaugh,  Dr.  E.  J.,  Educational  Service,  Extension  Division,  University  of  Iowa, 
Iowa  City,  Iowa. 

Averill,  William  A.,  617  Peoples  Gas  Buildmg,  Chicago,  Illinois. 

Baldwin,  Dr.  Bird  T.,  Director,  Child  Welfare  Research  Station,  University  of  Iowa, 
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Bright,  Ira  J.,  Superintendent  of  Schools,  Leavenworth,  Kansas. 

Brown,  Emma  M.,  Department  of  Measurements  and  Standards,  Public  Schools, 
Denver,  Colorado. 

Brown,  Dr.  H.  A.,  President,  Normal  School,  Oshkosh,  Wisconsin. 

Brueckner,  Dr.  L.  J.,  City  Normal  School,  Detroit,  Michigan. 

Buckingham,  Dr.  B.  R.,  Director,  Bureau  of  Educational  Research,  University  of 
Illinois,  Urbana,  Illinois. 

Buckner,  Dr.  C.  A.,  University  of  Pittsburgh,  Pittsburgh,  Pennsylvania. 

Burgess,  Mrs.  May  Ayres,  Secretary,  Department  of  Education,  Russell  Sage  Founda- 
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Dalman,  Murray  A.,  Director,  Educational  Research,  Board  of  Education,  Indiana- 
polis, Indiana. 

Davis,  Helen,  Director,  Mental  and  Educational  Measurements,  Jackson,  Michigan. 
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